00010000:00000010:1.1F:1776187635.805100:0:0:0:(ldlm_resource.c:1463:__ldlm_resource_free()) slab-freed '(res)': 224 at 00000000953d1a15. 00010000:00000010:1.1:1776187635.805124:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at 0000000038a75aae. 00010000:00000010:1.1:1776187636.579049:0:5378:0:(ldlm_resource.c:1463:__ldlm_resource_free()) slab-freed '(res)': 224 at 00000000050ac7ce. 00010000:00000010:1.1:1776187636.579063:0:5378:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at 0000000095d895e3. 00010000:00000010:3.1F:1776187636.585918:0:5496:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at 000000006523e5de. 00010000:00000010:3.1:1776187636.585933:0:5496:0:(ldlm_resource.c:1463:__ldlm_resource_free()) slab-freed '(res)': 224 at 0000000005c4bc30. 00010000:00000010:3.1:1776187636.585936:0:5496:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 560 at 000000000aaaccab. 00010000:00010000:3.0:1776187964.545285:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4387ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca825 expref: 639 pid: 5515 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1776187964.545309:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38b:0x0].0x0 (000000007f00126a) 00010000:00010000:3.0:1776187964.545314:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee438ac6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x38b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.545326:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee438ac6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x38b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.545334:0:7121:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee438ac6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x38b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.545373:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187964.545583:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f522d882 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+638:2224:x1862467653366848:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 375us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187964.545594:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4294 00000100:00100000:3.0:1776187964.551588:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.568254:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653367104 00010000:00010000:3.0:1776187964.568305:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee438ac6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x38b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca928 expref: 640 pid: 5517 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1776187964.568360:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4295 00000100:00100000:3.0:1776187964.568366:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d242284 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+640:2224:x1862467653367104:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187964.568383:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187964.568389:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee438ac6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x38b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca928 expref: 640 pid: 5517 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1776187964.568401:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee438ac6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x38b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca928 expref: 640 pid: 5517 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1776187964.568428:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee438ac6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x38b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca928 expref: 640 pid: 5517 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1776187964.568444:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38b:0x0].0x0 (000000007f00126a) 00010000:00010000:3.0:1776187964.568450:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee438ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.568460:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee438ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.568468:0:7121:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee438ae2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.568492:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187964.568542:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d242284 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+640:2224:x1862467653367104:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 175us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187964.568550:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4295 00000100:00100000:3.0:1776187964.575039:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.575156:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.582428:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.590149:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.613757:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.619990:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15161 00000100:00100000:3.0:1776187964.620075:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc81a111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+642:11303:x1862467653367616:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187964.620124:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1776187964.620143:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee438ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca92f expref: 642 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620156:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38b:0x0].0x0 (000000007f00126a) 00010000:00010000:3.0:1776187964.620170:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee438a95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca913 expref: 641 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620179:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:3.0:1776187964.620181:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187964.620207:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438b2f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620221:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438b2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620229:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438b2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620253:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620261:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620267:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620286:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620292:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620299:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620417:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620426:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.620432:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187964.625381:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4605, 224 off809472 00000004:00010000:3.0:1776187964.625497:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000cc81a111 reply state 00000000e36085d7 transno 4294974832 ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187964.626318:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000cc81a111 reply state 00000000e36085d7 transno 4294974832 ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.626328:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438b2f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.626335:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438b2f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.626342:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438b2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.626348:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087293dd7 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187964.626353:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438b2f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.626359:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438b2f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.626376:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:3.0:1776187964.626379:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187964.626384:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438b2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.626390:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438b2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187964.626404:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000cc81a111 reply state 00000000e36085d7 transno 4294974832 ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187964.632695:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc81a111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+642:11303:x1862467653367616:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 12681us (19739us total) trans 4294974832 rc 0/0 00000100:00100000:3.0:1776187964.632727:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15161 00000100:00100000:3.0:1776187964.639025:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653367744 00000100:00100000:3.0:1776187964.639088:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15162 00000100:00100000:3.0:1776187964.639095:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef529192 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+642:11304:x1862467653367744:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:3.0:1776187964.639129:0:6573:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187964.639152:0:6573:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438b4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24ca94b expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.643963:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644041:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644049:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644055:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000013464678 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187964.644059:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644067:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644084:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x17610ee3 (00000000d2ce93fe) 00010000:00010000:3.0:1776187964.644088:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187964.644092:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644099:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438b36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644116:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644122:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644127:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644136:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9415499 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187964.644138:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644143:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644150:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x57ca59f5 (000000005aa30e07) 00010000:00010000:3.0:1776187964.644152:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187964.644153:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644158:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438b3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644168:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644173:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644178:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644182:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000053723fa5 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187964.644184:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644189:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644196:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38b:0x0].0x0 (000000003846d7f8) 00010000:00010000:3.0:1776187964.644198:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1776187964.644200:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.644205:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187964.673678:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653367872 00010000:00010000:3.0:1776187964.673698:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438b21 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x38f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca944 expref: 646 pid: 5517 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1776187964.673765:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4297 00000100:00100000:3.0:1776187964.673770:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f1860e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+646:2225:x1862467653367872:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187964.673782:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187964.673788:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438b21 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x38f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca944 expref: 646 pid: 5517 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1776187964.673799:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438b21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x38f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca944 expref: 646 pid: 5517 timeout: 541 lvb_type: 0 00010000:00010000:3.0:1776187964.673920:0:5502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38f:0x0].0x0 (000000000f4996f9) 00010000:00010000:3.0:1776187964.673927:0:5502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438b6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38f:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.673935:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.673949:0:5502:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438b6e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x38f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.673968:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187964.673998:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f1860e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+646:2225:x1862467653367872:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 226us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187964.674015:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4297 00000100:00100000:3.0:1776187964.694440:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653368128 00000100:00100000:3.0:1776187964.694482:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4316 00000100:00100000:3.0:1776187964.694487:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000579b6adf pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+644:11304:x1862467653368128:12345-192.168.204.20@tcp:35:dbench.0 00000040:00080000:3.0:1776187964.694824:0:5519:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4606, 168 off809640 00000100:00100000:3.0:1776187964.694982:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000579b6adf pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+645:11304:x1862467653368128:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 493us (1734us total) trans 4294974833 rc 0/0 00000100:00100000:3.0:1776187964.694990:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4316 00000100:00100000:3.0:1776187964.730775:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653368320 00000100:00100000:3.0:1776187964.730872:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15166 00000100:00100000:3.0:1776187964.730924:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009bc6cc5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+645:11303:x1862467653368320:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:3.0:1776187964.730972:0:5517:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187964.731004:0:5517:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24ca967 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.731093:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.731114:0:5517:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee438b7c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x38b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca959 expref: 646 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.731129:0:5517:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438ba6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.731179:0:5517:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee438b7c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x38b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca959 expref: 646 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.731192:0:5517:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee438b7c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x38b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca959 expref: 646 pid: 5517 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1776187964.731208:0:5517:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000351b54b5 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5517:1862467659895680:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187964.731327:0:5517:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f0c7b3fd going to sleep for 43 seconds 00000100:00100000:3.0:1776187964.740848:0:5517:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000351b54b5 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5517:1862467659895680:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187964.740923:0:5517:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.741619:0:5517:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.741657:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187964.741783:0:5517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x38b:0x0]: returning size 15360 00000004:00200000:3.0:1776187964.741790:0:5517:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187964.741833:0:5517:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.741901:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.741953:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438b9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca967 expref: 644 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.741976:0:5517:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca967 expref: 643 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.741985:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38b:0x0].0x0 (000000006c0357c0) 00010000:00010000:3.0:1776187964.741988:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1776187964.741992:0:5517:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d9415499, rc 0) 00000100:00100000:3.0:1776187964.742566:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009bc6cc5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+643:11303:x1862467653368320:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 11640us (11982us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187964.742580:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15166 00010000:00010000:3.0:1776187964.769168:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.769187:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438bc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.769194:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.769202:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc9474fb already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187964.769207:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.769216:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438bc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.769253:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38b:0x0].0x0 (000000003be36f4d) 00010000:00010000:3.0:1776187964.769257:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187964.769262:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438bc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.769268:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438bc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.786657:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee438be5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca96e expref: 645 pid: 6573 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1776187964.786680:0:5517:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003469a13f pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5517:1862467659895744:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187964.786710:0:5517:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee438bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x38f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.786720:0:5517:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee438bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x38f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.786726:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee438bfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x38f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187964.786750:0:5517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x38f:0x0]: returning size 15360 00010000:00010000:3.0:1776187964.786941:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee438bf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca97c expref: 646 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.786957:0:5517:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee438bfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x38f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca97c expref: 645 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.786971:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38f:0x0].0x0 (00000000a45e680a) 00010000:00010000:3.0:1776187964.786974:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1776187964.786977:0:5517:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000025e5acf1, rc 0) 00000100:00100000:3.0:1776187964.787011:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c4fc8fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+645:11304:x1862467653368896:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 13552us (17221us total) trans 4294974837 rc 0/0 00000100:00100000:3.0:1776187964.787019:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15171 00000100:00100000:3.0:1776187964.799849:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653369088 00000100:00100000:3.0:1776187964.804059:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.820607:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187964.823689:0:6573:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee438c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.823723:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee438c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187964.823789:0:6573:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x38f:0x0]: returning size 15360 00000004:00200000:3.0:1776187964.823796:0:6573:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187964.823827:0:6573:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee438c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.823848:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee438c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.824198:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee438c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca983 expref: 648 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.824219:0:6573:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee438c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca983 expref: 647 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.824244:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38f:0x0].0x0 (00000000a45e680a) 00010000:00010000:3.0:1776187964.824248:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1776187964.824252:0:6573:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ec1ebc7a, rc 0) 00000100:00100000:3.0:1776187964.824338:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005589373c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+647:11304:x1862467653369088:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 24079us (26276us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187964.824546:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15172 00000100:00100000:3.0:1776187964.825630:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.835025:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.839265:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.849513:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653369856 00000100:00100000:3.0:1776187964.849562:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 677 00000100:00100000:3.0:1776187964.849567:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020025a1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+652:2224:x1862467653369856:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187964.849580:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187964.849611:0:5502:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee438c47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38c:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca998 expref: 652 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.849632:0:5502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38c:0x0].0x0 (000000004c664cf8) 00010000:00010000:3.0:1776187964.849639:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187964.869012:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020025a1b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+650:2224:x1862467653369856:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 19428us (20489us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187964.869038:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 677 00000100:00100000:3.0:1776187964.872265:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653369920 00000100:00100000:3.0:1776187964.872360:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15176 00000100:00100000:3.0:1776187964.872369:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba7165d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+650:11303:x1862467653369920:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:3.0:1776187964.872413:0:6573:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187964.872444:0:6573:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438c5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24ca99f expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.872532:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438c63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.872555:0:6573:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee438c39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x38e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca991 expref: 651 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.872563:0:6573:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438c63 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.872672:0:6573:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee438c39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x38e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca991 expref: 651 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.872690:0:6573:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee438c39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x38e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca991 expref: 651 pid: 6573 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1776187964.872720:0:6573:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bb204951 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6573:1862467659895936:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187964.872839:0:6573:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f0c7b3fd going to sleep for 43 seconds 00010000:00010000:3.0:1776187964.888858:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee438c39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x38e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca991 expref: 651 pid: 6573 timeout: 541 lvb_type: 0 00000100:00100000:3.0:1776187964.888928:0:6573:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bb204951 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6573:1862467659895936:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187964.888962:0:6573:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.888980:0:6573:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.888986:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187964.889053:0:6573:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x38e:0x0]: returning size 15360 00000004:00200000:3.0:1776187964.889058:0:6573:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187964.889087:0:6573:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.889105:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.889142:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438c5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca99f expref: 651 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.889156:0:6573:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca99f expref: 650 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.889166:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38e:0x0].0x0 (000000001efc7c4f) 00010000:00010000:3.0:1776187964.889169:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1776187964.889173:0:6573:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000013464678, rc 0) 00000100:00100000:3.0:1776187964.889276:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba7165d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+650:11303:x1862467653369920:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 16906us (19806us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187964.889287:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15176 00000100:00100000:3.0:1776187964.892465:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653370176 00000100:00100000:3.0:1776187964.892543:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15178 00000100:00100000:3.0:1776187964.892552:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6f5053 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+650:11304:x1862467653370176:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:3.0:1776187964.892584:0:6573:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187964.892613:0:6573:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24ca9a6 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892694:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438c8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892713:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892725:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892741:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x202:0x0].0x44fbd80 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892747:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x44fbd80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892753:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x44fbd80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892841:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892849:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438c8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892856:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438c8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892863:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000332541f8 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187964.892867:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438c8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892897:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438c8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.892910:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:3.0:1776187964.892913:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187964.892918:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438c8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893191:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438c8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893205:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x44fbd80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893211:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438c94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x44fbd80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893217:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x44fbd80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893222:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009723c662 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187964.893224:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x44fbd80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893240:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x44fbd80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893250:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x44fbd80 (000000003846d7f8) 00010000:00010000:3.0:1776187964.893253:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187964.893255:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438c94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x202:0x0].0x44fbd80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893261:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438c94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x202:0x0].0x44fbd80 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893301:0:6573:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438c86 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9a6 expref: 651 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893310:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9a6 expref: 651 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.893321:0:6573:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000087293dd7, rc 0) 00000100:00100000:3.0:1776187964.893435:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6f5053 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+650:11304:x1862467653370176:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 882us (1631us total) trans 0 rc 301/301 00000100:00100000:3.0:1776187964.893444:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15178 00000100:00100000:3.0:1776187964.920066:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.920121:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.921196:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15180 00000100:00100000:3.0:1776187964.921226:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003642cc65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+652:11304:x1862467653370432:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:3.0:1776187964.921272:0:5515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187964.921299:0:5515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438cb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24ca9b4 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.921819:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438cb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.921844:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.922289:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187964.922359:0:5515:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x202:0x0]: returning size 11776 00000004:00200000:3.0:1776187964.922363:0:5515:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187964.924651:0:5515:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.926193:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438cb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9b4 expref: 652 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.926221:0:5515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9b4 expref: 651 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.926238:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:3.0:1776187964.926241:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1776187964.926244:0:5515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009723c662, rc 0) 00000100:00100000:3.0:1776187964.926326:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003642cc65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+651:11304:x1862467653370432:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 5112us (6204us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187964.926337:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15180 00000100:00100000:3.0:1776187964.933987:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187964.934055:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187964.974621:0:5515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187964.974655:0:5515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee438ccc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24ca9c2 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187964.974830:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x206:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187964.974854:0:5515:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000a78fe4d9/0x92b1eb87ee41dc2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19bd expref: 655 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187964.974865:0:5515:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438cd3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x206:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187964.975178:0:5515:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000a78fe4d9/0x92b1eb87ee41dc2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19bd expref: 655 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187964.975196:0:5515:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000a78fe4d9/0x92b1eb87ee41dc2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19bd expref: 655 pid: 5516 timeout: 541 lvb_type: 0 00000100:00100000:2.0:1776187964.975213:0:5515:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ceb0237 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5515:1862467659896000:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187964.975359:0:5515:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b99c0264 going to sleep for 43 seconds 00000100:00100000:3.0:1776187964.987612:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653370816 00000100:00100000:3.0:1776187964.987678:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15183 00000100:00100000:3.0:1776187964.987685:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9b6fe4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+654:11303:x1862467653370816:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:3.0:1776187964.987722:0:6573:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187964.987753:0:6573:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438cda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24ca9c9 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.987826:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438ce1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.987847:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.987860:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.987925:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438ce8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.987933:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187964.987939:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187964.988829:0:5515:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ceb0237 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5515:1862467659896000:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187964.988860:0:5515:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438cd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x206:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187964.996432:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187965.004131:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438cfd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004146:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438cfd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004155:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438cfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004161:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004fba2add already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.004165:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438cfd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004172:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438cfd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004188:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x10682665 (00000000a7c2e43a) 00010000:00010000:3.0:1776187965.004191:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.004194:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438cfd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004199:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438cfd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004220:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438d04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004226:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438d04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004241:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438d04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004247:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc9474fb already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.004249:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438d04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004254:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438d04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004261:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x17610ee3 (00000000298f4138) 00010000:00010000:3.0:1776187965.004263:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.004264:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438d04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004269:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438d04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004278:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438d0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004284:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438d0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004289:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438d0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004294:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d042148c already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.004295:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438d0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004300:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438d0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004306:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38e:0x0].0x0 (000000004c664cf8) 00010000:00010000:3.0:1776187965.004307:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1776187965.004309:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438d0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.004315:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438d0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x21/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187965.007540:0:5515:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x38e:0x0]: returning size 15360 00000004:00200000:2.0:1776187965.007548:0:5515:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187965.007580:0:5515:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee438d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007599:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee438d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007609:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025a9ff81/0x92b1eb87ee438d19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007616:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025a9ff81/0x92b1eb87ee438d19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007624:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025a9ff81/0x92b1eb87ee438d19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007630:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025a9ff81 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.007633:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025a9ff81/0x92b1eb87ee438d19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007640:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025a9ff81/0x92b1eb87ee438d19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007655:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:2.0:1776187965.007657:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.007661:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025a9ff81/0x92b1eb87ee438d19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007667:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025a9ff81/0x92b1eb87ee438d19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007680:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee438d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007685:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee438d20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.007689:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee438d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.008488:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c48750ea already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.008492:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee438d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.008500:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee438d20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.008511:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x17610ee3 (00000000f056c6a6) 00010000:00010000:2.0:1776187965.008514:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.008516:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee438d20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.008522:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee438d20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.008570:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee438d12 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9d0 expref: 653 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.008582:0:5515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee438d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9d0 expref: 652 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.008588:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38e:0x0].0x0 (00000000eb7ad866) 00010000:00010000:2.0:1776187965.008590:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1776187965.008592:0:5515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009615f87f, rc 0) 00000100:00100000:2.0:1776187965.008680:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084c31738 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+652:11303:x1862467653371072:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 3772us (4628us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187965.008689:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15185 00000100:00100000:3.0:1776187965.009521:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.019246:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653371264 00000100:00100000:2.0:1776187965.019345:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15187 00000100:00100000:2.0:1776187965.019352:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035e534c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+654:11303:x1862467653371264:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:2.0:1776187965.019375:0:5515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187965.019394:0:5515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438d3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24ca9de expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.019497:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee438d43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x38e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.019513:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee438d43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x38e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.019528:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee438d43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x38e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187965.019540:0:5515:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x38e:0x0]: returning size 15360 00010000:00010000:2.0:1776187965.019673:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438d3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9de expref: 657 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.019691:0:5515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee438d43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9de expref: 656 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.019699:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38e:0x0].0x0 (00000000eb7ad866) 00010000:00010000:2.0:1776187965.019701:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1776187965.019705:0:5515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d47697e3, rc 0) 00000100:00100000:2.0:1776187965.019759:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035e534c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+656:11303:x1862467653371264:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 406us (1034us total) trans 4294974846 rc 0/0 00000100:00100000:2.0:1776187965.019766:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15187 00000100:00100000:3.0:1776187965.019996:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.032975:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.033016:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.033987:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653371584 00000100:00100000:2.0:1776187965.034026:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15188 00000100:00100000:2.0:1776187965.034031:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b40c6e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+655:11303:x1862467653371584:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.034063:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187965.034087:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee438d27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9d0 expref: 655 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.034105:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38e:0x0].0x0 (00000000eb7ad866) 00010000:00010000:2.0:1776187965.034110:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.034147:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438d51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.034161:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.034169:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.034291:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001b40c6e7 reply state 00000000ca24537f transno 4294974848 ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438d51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.034478:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b40c6e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+656:11303:x1862467653371584:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 446us (1461us total) trans 4294974848 rc 0/0 00000100:00100000:2.0:1776187965.034484:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15188 00000100:00100000:3.0:1776187965.042755:0:11824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653371712 00000100:00100000:3.0:1776187965.042815:0:11824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 2785 00000100:00100000:3.0:1776187965.042821:0:11824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066f354e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fec2a005-a0e4-4122-9d32-29d5f089fd24+88:2224:x1862467653371712:12345-192.168.204.20@tcp:2:dbench.0 00002000:00010000:3.0:1776187965.043047:0:11824:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x100010000:0x1ab:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1776187965.043050:0:11824:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x100010000:0x1ab:0x0] updating lvb mtime from disk: 1776187940 -> 1776187952 00002000:00010000:3.0:1776187965.043052:0:11824:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x100010000:0x1ab:0x0] updating lvb atime from disk: 1776187944 -> 1776187954 00002000:00010000:3.0:1776187965.043054:0:11824:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x100010000:0x1ab:0x0] updating lvb ctime from disk: 1776187964 -> 1776187964 00002000:00010000:3.0:1776187965.043056:0:11824:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x100010000:0x1ab:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1776187965.043113:0:11824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066f354e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:fec2a005-a0e4-4122-9d32-29d5f089fd24+89:2224:x1862467653371712:12345-192.168.204.20@tcp:2:dbench.0 Request processed in 290us (729us total) trans 4294968169 rc 0/0 00000100:00100000:3.0:1776187965.043121:0:11824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 2785 00000100:00100000:2.0:1776187965.067183:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653372032 00000100:00100000:2.0:1776187965.067250:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15193 00000100:00100000:2.0:1776187965.067256:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007912692b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+657:11304:x1862467653372032:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:2.0:1776187965.067277:0:5517:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187965.067301:0:5517:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438d97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24ca9fa expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067377:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438d9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067397:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067411:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067433:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x202:0x0].0x10682665 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067442:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067449:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067534:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067542:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438d9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067550:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438d9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067557:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c8d05e already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.067562:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438d9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067571:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438d9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067584:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:2.0:1776187965.067586:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.067592:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438d9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067598:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438d9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067615:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067621:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438da5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067626:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067630:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.067632:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067638:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438da5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067644:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x10682665 (0000000063901265) 00010000:00010000:2.0:1776187965.067646:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.067648:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438da5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x202:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067653:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x202:0x0].0x10682665 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067688:0:5517:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438d97 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9fa expref: 658 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067701:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438d97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9fa expref: 658 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.067710:0:5517:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006b72ffb6, rc 0) 00000100:00100000:2.0:1776187965.067796:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007912692b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+657:11304:x1862467653372032:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 539us (734us total) trans 0 rc 301/301 00000100:00100000:2.0:1776187965.067803:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15193 00000100:00100000:3.0:1776187965.068769:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187965.068846:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438d90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.068862:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438d90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.068868:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438d90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.068910:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000095ae11d5 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.068914:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438d90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.068925:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438d90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.068938:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38e:0x0].0x0 (00000000eb7ad866) 00010000:00010000:2.0:1776187965.068941:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.068944:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438d90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.068950:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438d90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.077591:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.077692:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.087159:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653372160 00000100:00100000:2.0:1776187965.087242:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4323 00000100:00100000:2.0:1776187965.087248:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006538300c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+657:11304:x1862467653372160:12345-192.168.204.20@tcp:37:dbench.0 00000100:00100000:2.0:1776187965.104168:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d058849 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+656:11303:x1862467653372224:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 13941us (26575us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187965.104187:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4324 00000100:00100000:3.0:1776187965.104591:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.106148:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.121748:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653372544 00000100:00100000:2.0:1776187965.121812:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15195 00000100:00100000:2.0:1776187965.121819:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b7505a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+660:11360:x1862467653372544:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:2.0:1776187965.121846:0:5517:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187965.121871:0:5517:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438db3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa08 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.121928:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa08 expref: 661 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.121943:0:5517:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa08 expref: 661 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.121951:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (00000000b347ce5e) 00010000:00010000:2.0:1776187965.121954:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.121958:0:5517:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006b72ffb6, rc 0) 00000100:00100000:2.0:1776187965.122263:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b7505a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+661:11360:x1862467653372544:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 442us (2135us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187965.122271:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15195 00000100:00100000:3.0:1776187965.126117:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.128261:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653372672 00000100:00100000:2.0:1776187965.128331:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4327 00000100:00100000:2.0:1776187965.128338:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044f45045 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+660:11303:x1862467653372672:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.128683:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044f45045 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+661:11303:x1862467653372672:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 344us (2721us total) trans 4294974851 rc 0/0 00000100:00100000:2.0:1776187965.128692:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4327 00000100:00100000:2.0:1776187965.132009:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653372800 00000100:00100000:2.0:1776187965.132064:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15196 00000100:00100000:2.0:1776187965.132070:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc8bb61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+660:11304:x1862467653372800:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.132126:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1776187965.132152:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000056273ae8/0x92b1eb87ee421963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x200:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c315d expref: 660 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.132175:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d6cf47c3/0x92b1eb87ee41d975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x200:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18c8 expref: 659 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.132191:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4219ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x200:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3180 expref: 658 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.132202:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000283082be/0x92b1eb87ee41d94b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x200:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18b3 expref: 657 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.132211:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x200:0x0].0x0 (0000000041aecb5c) 00010000:00010000:2.0:1776187965.132236:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d2e0b339/0x92b1eb87ee4210f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2e9a expref: 656 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.132245:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (00000000cf81227d) 00010000:00010000:2.0:1776187965.132248:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.132279:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.132293:0:12471:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee438dac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa01 expref: 655 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.132300:0:12471:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.132334:0:12471:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee438dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa01 expref: 655 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.132345:0:12471:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee438dac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa01 expref: 655 pid: 12471 timeout: 542 lvb_type: 0 00000100:00100000:2.0:1776187965.132358:0:12471:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008865b48e pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12471:1862467659896128:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187965.132435:0:12471:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b99c0264 going to sleep for 43 seconds 00000100:00100000:3.0:1776187965.140487:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653372992 00000100:00100000:3.0:1776187965.140538:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15197 00000100:00100000:3.0:1776187965.140545:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5876235 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+658:11303:x1862467653372992:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187965.140591:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1776187965.140620:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee4216a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c307d expref: 658 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.140640:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002c16e861/0x92b1eb87ee41d7b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c180b expref: 657 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.140650:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003aff9356/0x92b1eb87ee4216c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1fb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c308b expref: 656 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.140661:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005d7ce3e4/0x92b1eb87ee41d7a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1fb:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1804 expref: 655 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.140669:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fb:0x0].0x0 (0000000000b4c578) 00010000:00010000:3.0:1776187965.140682:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee42117c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ecb expref: 654 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.140688:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (00000000b347ce5e) 00010000:00010000:3.0:1776187965.140690:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187965.140725:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438dc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.140737:0:5517:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438db3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa08 expref: 653 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.140745:0:5517:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438dc1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.140781:0:5517:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa08 expref: 653 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.140791:0:5517:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438db3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa08 expref: 653 pid: 5517 timeout: 542 lvb_type: 0 00000100:00100000:3.0:1776187965.140804:0:5517:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000035ef4933 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5517:1862467659896192:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187965.140865:0:5517:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f0c7b3fd going to sleep for 43 seconds 00000100:00100000:2.0:1776187965.143405:0:12471:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008865b48e pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12471:1862467659896128:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187965.143441:0:12471:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.155957:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.156611:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653373056 00010000:00010000:2.0:1776187965.156680:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee438dac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa01 expref: 652 pid: 12471 timeout: 542 lvb_type: 0 00000100:00100000:2.0:1776187965.156731:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653373120 00010000:00010000:2.0:1776187965.156742:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438db3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa08 expref: 653 pid: 5517 timeout: 542 lvb_type: 0 00000100:00100000:2.0:1776187965.156772:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4306 00000100:00100000:2.0:1776187965.156778:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000558a9922 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+653:2224:x1862467653373056:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1776187965.156793:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187965.156799:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee438dac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa01 expref: 653 pid: 12471 timeout: 542 lvb_type: 0 00010000:00010000:2.0:1776187965.156809:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee438dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa01 expref: 653 pid: 12471 timeout: 542 lvb_type: 0 00010000:00010000:2.0:1776187965.156831:0:5502:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee438dac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa01 expref: 653 pid: 12471 timeout: 542 lvb_type: 0 00010000:00010000:2.0:1776187965.156846:0:5502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (00000000cf81227d) 00010000:00010000:2.0:1776187965.156850:0:5502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.156867:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.156904:0:5502:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.156934:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.156957:0:12471:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.156965:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.157530:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438dc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f3:0x0].0xe2501d74 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.157539:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.157547:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.157673:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee438dcf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x200:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.157681:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee438dcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.157687:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee438dcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x200:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.160556:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000558a9922 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+650:2224:x1862467653373056:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 3770us (12389us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.160571:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4306 00000040:00080000:2.0:1776187965.161812:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].369, 64 off31872 00000040:00080000:2.0:1776187965.161830:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4616, 184 off811376 00010000:00010000:2.0:1776187965.162910:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x200:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.162930:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x200:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.162942:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x200:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.162950:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x200:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.162956:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x200:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.162963:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x200:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.162983:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.163008:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ebc8bb61 reply state 00000000d8af28fd transno 4294974853 ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee438dcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x200:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163067:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163073:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163080:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163085:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.163089:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163097:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163108:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (00000000cf81227d) 00010000:00010000:2.0:1776187965.163112:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.163116:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163121:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438dba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.163130:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ebc8bb61 reply state 00000000d8af28fd transno 4294974853 ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438dc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.163216:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc8bb61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+652:11304:x1862467653372800:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 31144us (31372us total) trans 4294974853 rc 0/0 00000100:00100000:2.0:1776187965.163237:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15196 00010000:00010000:2.0:1776187965.163274:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187965.163280:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x200:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163292:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089fb6120 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187965.163296:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x200:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163302:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x200:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163312:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x200:0x0].0x0 (00000000780f5f5c) 00010000:00010000:2.0:1776187965.163314:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187965.163316:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x200:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163322:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438deb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x200:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.163331:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.163333:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.163335:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.168690:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187965.168702:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee438de4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.168718:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187965.168723:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee438de4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.168734:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee438de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.168765:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fb:0x0].0x0 (000000007842f307) 00010000:00010000:2.0:1776187965.168768:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187965.168773:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee438de4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.168779:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee438de4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.168800:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.168801:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.168803:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.173125:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee438dd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173159:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee438dd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173168:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee438dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173175:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4841773 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.173180:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee438dd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173188:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee438dd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173208:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0xd8045a37 (00000000e5f011d9) 00010000:00010000:2.0:1776187965.173212:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.173220:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee438dd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173235:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee438dd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173262:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee438ddd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173268:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee438ddd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173273:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee438ddd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173278:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.173281:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee438ddd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173287:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee438ddd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173295:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fb:0x0].0x0 (000000007842f307) 00010000:00010000:2.0:1776187965.173297:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187965.173300:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee438ddd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.173306:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee438ddd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.178528:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653373248 00000100:00100000:3.0:1776187965.178590:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15198 00000100:00100000:3.0:1776187965.178597:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ea4731e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+650:2223:x1862467653373248:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:3.0:1776187965.178629:0:5517:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187965.178651:0:5517:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438df2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa16 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181357:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181383:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181393:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181412:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181418:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181425:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181545:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438e31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181555:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181562:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187965.181603:0:5517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x26d:0x0]: returning size 11776 00000004:00200000:3.0:1776187965.181606:0:5517:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187965.181632:0:5517:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181643:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181650:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181657:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181663:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000013464678 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.181667:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181673:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181684:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:3.0:1776187965.181686:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.181690:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181695:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181707:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181712:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181717:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181721:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087293dd7 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.181723:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181727:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181733:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x106120ec (000000005aa30e07) 00010000:00010000:3.0:1776187965.181736:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.181738:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181743:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181779:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438df2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa16 expref: 654 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181793:0:5517:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa16 expref: 653 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.181801:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26d:0x0].0x0 (000000001ecff654) 00010000:00010000:3.0:1776187965.181803:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1776187965.181805:0:5517:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000053723fa5, rc 0) 00000100:00100000:3.0:1776187965.181917:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ea4731e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+653:2223:x1862467653373248:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 3318us (3962us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.181928:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15198 00000100:00100000:2.0:1776187965.183417:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653373440 00000100:00100000:2.0:1776187965.183474:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4329 00000100:00100000:2.0:1776187965.183481:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d242284 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+653:11304:x1862467653373440:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.183730:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d242284 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+654:11304:x1862467653373440:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 248us (504us total) trans 4294974854 rc 0/0 00000100:00100000:2.0:1776187965.183739:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4329 00010000:00010000:3.0:1776187965.189849:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187965.189854:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee438e4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308747950528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.189891:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9325880 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187965.189895:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee438e4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308747950528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.189907:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee438e4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308747950528 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.189918:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fe:0x0].0x0 (000000007842f307) 00010000:00010000:3.0:1776187965.189920:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187965.189922:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee438e4d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308747950528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.189928:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee438e4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308747950528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.189941:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.189942:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.189943:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187965.196125:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653373632 00000100:00100000:3.0:1776187965.196195:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4330 00000100:00100000:3.0:1776187965.196205:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+651:11303:x1862467653373632:12345-192.168.204.20@tcp:37:dbench.0 00000100:00100000:3.0:1776187965.199599:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.207088:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+652:11303:x1862467653373632:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 10871us (11221us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.207107:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4330 00000100:00100000:2.0:1776187965.211984:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.212025:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653373888 00000100:00100000:3.0:1776187965.212080:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15202 00000100:00100000:3.0:1776187965.212087:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008865b48e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+652:11304:x1862467653373888:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187965.212145:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187965.212185:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000081625344/0x92b1eb87ee421400 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2f96 expref: 652 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212208:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c81623fe/0x92b1eb87ee41d62d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1763 expref: 651 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212219:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e55a7922/0x92b1eb87ee42147e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2fc0 expref: 650 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212240:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c014d47c/0x92b1eb87ee41d618 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1755 expref: 649 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212250:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f7:0x0].0x0 (00000000bf4d58b7) 00010000:00010000:3.0:1776187965.212258:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187965.212286:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212299:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212309:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212322:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212328:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212334:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212502:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212510:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.212517:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187965.213497:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].375, 64 off32256 00000040:00080000:3.0:1776187965.213529:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4618, 184 off811744 00010000:00010000:3.0:1776187965.213609:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213623:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213643:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213652:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213657:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213664:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213691:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187965.213709:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008865b48e reply state 000000009d411807 transno 4294974857 ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213761:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213768:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e54 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213774:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213781:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000034ce9c59 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.213784:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213791:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213803:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (00000000cf81227d) 00010000:00010000:3.0:1776187965.213806:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.213809:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.213827:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187965.213837:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008865b48e reply state 000000009d411807 transno 4294974857 ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.213948:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008865b48e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+650:11304:x1862467653373888:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1858us (1972us total) trans 4294974857 rc 0/0 00000100:00100000:3.0:1776187965.213967:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15202 00010000:00010000:2.0:1776187965.215478:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187965.215488:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.215503:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000332541f8 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187965.215507:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.215516:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.215532:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f7:0x0].0x0 (00000000d2ce93fe) 00010000:00010000:2.0:1776187965.215534:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187965.215538:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.215543:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438e69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.215558:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.215560:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.215562:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.219129:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219153:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219161:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219167:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087293dd7 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.219172:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219179:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219196:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0xbf0c4e99 (000000005aa30e07) 00010000:00010000:2.0:1776187965.219200:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.219204:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219210:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438e5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f3:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219238:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219245:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219251:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219257:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000013464678 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.219260:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219265:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219278:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f7:0x0].0x0 (00000000d2ce93fe) 00010000:00010000:2.0:1776187965.219280:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187965.219283:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.219288:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438e62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.227170:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.227288:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653374016 00000100:00100000:2.0:1776187965.227356:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4332 00000100:00100000:2.0:1776187965.227363:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044f45045 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+649:11304:x1862467653374016:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.227632:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044f45045 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+650:11304:x1862467653374016:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 267us (469us total) trans 4294974858 rc 0/0 00000100:00100000:2.0:1776187965.227640:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4332 00000100:00100000:2.0:1776187965.240180:0:10981:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653374144 00000100:00100000:2.0:1776187965.240252:0:10981:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15203 00000100:00100000:2.0:1776187965.240259:0:10981:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066a6b0b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+650:11304:x1862467653374144:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.240323:0:10981:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.240350:0:10981:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000049d5e60e/0x92b1eb87ee4216f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fc:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3099 expref: 650 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240374:0:10981:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a0333dda/0x92b1eb87ee41d7f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1827 expref: 649 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240386:0:10981:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000046f67683/0x92b1eb87ee421717 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1fc:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c30a7 expref: 648 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240398:0:10981:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba8142ba/0x92b1eb87ee41d7d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1fc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1819 expref: 647 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240407:0:10981:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fc:0x0].0x0 (0000000055bfb207) 00010000:00010000:2.0:1776187965.240416:0:10981:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.240449:0:10981:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438e70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240464:0:10981:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438e70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240474:0:10981:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438e70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240490:0:10981:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438e77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f3:0x0].0xd8045a37 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240497:0:10981:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240504:0:10981:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240608:0:10981:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee438e7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240617:0:10981:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee438e7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.240623:0:10981:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee438e7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.241322:0:10981:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].371, 64 off32000 00000040:00080000:2.0:1776187965.241350:0:10981:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4619, 184 off811928 00010000:00010000:2.0:1776187965.241414:0:10981:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee438e85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1fc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241426:0:10981:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee438e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308747950528 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241435:0:10981:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee438e85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308747950528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241443:0:10981:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee438e85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308747950528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241448:0:10981:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee438e85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308747950528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241455:0:10981:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee438e85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308747950528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241484:0:10981:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.241505:0:10981:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000066a6b0b5 reply state 0000000071710bf1 transno 4294974859 ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee438e7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241554:0:10981:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438e70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241558:0:10981:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438e70 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241563:0:10981:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438e70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241566:0:10981:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089fb6120 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.241569:0:10981:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438e70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241573:0:10981:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438e70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241580:0:10981:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (00000000cf81227d) 00010000:00010000:2.0:1776187965.241582:0:10981:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.241584:0:10981:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438e70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.241588:0:10981:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438e70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.241594:0:10981:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000066a6b0b5 reply state 0000000071710bf1 transno 4294974859 ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee438e77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xd8045a37 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.241679:0:10981:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066a6b0b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+648:11304:x1862467653374144:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1419us (2159us total) trans 4294974859 rc 0/0 00000100:00100000:2.0:1776187965.241687:0:10981:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15203 00000100:00100000:3.0:1776187965.242257:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653374272 00000100:00100000:3.0:1776187965.242301:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4333 00000100:00100000:3.0:1776187965.242307:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c325c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+648:11303:x1862467653374272:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187965.242469:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c325c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+649:11303:x1862467653374272:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 161us (492us total) trans 4294974860 rc 0/0 00000100:00100000:3.0:1776187965.242475:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4333 00000100:00100000:3.0:1776187965.256283:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653374400 00000100:00100000:3.0:1776187965.256346:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15204 00000100:00100000:3.0:1776187965.256355:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006e0d3e76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+648:11303:x1862467653374400:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187965.256420:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1776187965.256445:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eb68e443/0x92b1eb87ee424332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3eed expref: 648 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256467:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7409f46/0x92b1eb87ee41f15b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c223e expref: 647 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256479:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000055481c3f/0x92b1eb87ee4243c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3f10 expref: 646 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256489:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000008bf8582/0x92b1eb87ee41f13f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2230 expref: 645 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256501:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23a:0x0].0x0 (0000000069e03f26) 00010000:00010000:3.0:1776187965.256518:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee438e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x234:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa0f expref: 644 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256529:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x234:0x0].0x0 (0000000044964d16) 00010000:00010000:3.0:1776187965.256532:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187965.256682:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x234:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256702:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256711:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256726:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256732:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256738:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256852:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.256860:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257057:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187965.257512:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].372, 64 off32064 00000040:00080000:3.0:1776187965.257533:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4620, 184 off812112 00010000:00010000:3.0:1776187965.257595:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438ea1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257607:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257615:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257622:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438ea1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257628:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438ea1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257634:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000013464678/0x92b1eb87ee438ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257664:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187965.257689:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006e0d3e76 reply state 000000003bbe886e transno 4294974861 ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257746:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257754:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e8c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257760:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257766:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000034ce9c59 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.257771:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257780:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257791:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x234:0x0].0x0 (0000000044964d16) 00010000:00010000:3.0:1776187965.257793:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.257798:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.257804:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034ce9c59/0x92b1eb87ee438e8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187965.257813:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006e0d3e76 reply state 000000003bbe886e transno 4294974861 ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.257965:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006e0d3e76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+645:11303:x1862467653374400:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1605us (1993us total) trans 4294974861 rc 0/0 00000100:00100000:3.0:1776187965.257979:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15204 00000100:00100000:3.0:1776187965.264746:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653374464 00000100:00100000:3.0:1776187965.264818:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15205 00000100:00100000:3.0:1776187965.264826:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f917b6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+645:2223:x1862467653374464:12345-192.168.204.20@tcp:101:ll_sa_11304.0 00010000:00010000:3.0:1776187965.264943:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187965.264968:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438ea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa24 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265037:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438eaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265056:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265069:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265087:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265093:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265099:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265415:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee438ebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265424:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee438ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x244:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265431:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee438ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x244:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187965.265506:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x244:0x0]: returning size 12800 00000004:00200000:3.0:1776187965.265509:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187965.265550:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee438ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x244:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265561:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438eaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265567:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438eaf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265573:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438eaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265578:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000332541f8 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.265582:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438eaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265588:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438eaf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265598:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:3.0:1776187965.265601:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.265605:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438eaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265610:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000332541f8/0x92b1eb87ee438eaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265628:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265634:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265639:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265643:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d1e21c8b already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.265646:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265652:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265658:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x56ca4f59 (0000000015f09a80) 00010000:00010000:3.0:1776187965.265660:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.265662:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438eb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265667:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d1e21c8b/0x92b1eb87ee438eb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265697:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087293dd7/0x92b1eb87ee438ea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa24 expref: 647 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265709:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee438ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x244:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa24 expref: 646 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.265720:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:3.0:1776187965.265722:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1776187965.265724:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000005bf1cdd, rc 0) 00000100:00100000:3.0:1776187965.265789:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f917b6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+646:2223:x1862467653374464:12345-192.168.204.20@tcp:101:ll_sa_11304.0 Request processed in 962us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.265796:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15205 00010000:00010000:2.0:1776187965.273428:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273458:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273467:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273473:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9415499 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.273478:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273485:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273505:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x234:0x0].0xdf197568 (0000000037029ea1) 00010000:00010000:2.0:1776187965.273508:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.273513:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273519:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d9415499/0x92b1eb87ee438e93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x234:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273546:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273553:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273558:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273563:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006453a6de already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.273565:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273571:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273577:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23a:0x0].0x0 (000000006f67d5a2) 00010000:00010000:2.0:1776187965.273579:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187965.273581:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.273586:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006453a6de/0x92b1eb87ee438e9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x23a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.277964:0:10981:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653374528 00000100:00100000:3.0:1776187965.278008:0:10981:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653374592 00000100:00100000:3.0:1776187965.278034:0:10981:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15206 00000100:00100000:3.0:1776187965.278040:0:10981:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074e0543b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+647:2222:x1862467653374528:12345-192.168.204.20@tcp:101:ll_sa_11304.0 00010000:00010000:3.0:1776187965.278062:0:10981:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187965.278084:0:10981:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438ec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa2b expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278150:0:10981:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438ecb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278167:0:10981:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438ecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278180:0:10981:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438ecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278195:0:10981:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438ed2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278202:0:10981:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278209:0:10981:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278332:0:10981:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee438ed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278342:0:10981:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee438ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278349:0:10981:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee438ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187965.278551:0:10981:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x21c:0x0]: returning size 12800 00000004:00200000:3.0:1776187965.278556:0:10981:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187965.278584:0:10981:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee438ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278596:0:10981:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438ecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278602:0:10981:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438ecb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278609:0:10981:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438ecb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278615:0:10981:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b9973b27 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.278619:0:10981:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438ecb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278632:0:10981:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438ecb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278644:0:10981:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:3.0:1776187965.278647:0:10981:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.278652:0:10981:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438ecb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278658:0:10981:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438ecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278672:0:10981:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278678:0:10981:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438ed2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278683:0:10981:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278695:0:10981:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000547596a2 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.278697:0:10981:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278702:0:10981:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438ed2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278709:0:10981:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x8cffc40b (00000000adef1ff2) 00010000:00010000:3.0:1776187965.278712:0:10981:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.278714:0:10981:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438ed2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278718:0:10981:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438ed2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278749:0:10981:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438ec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa2b expref: 649 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278761:0:10981:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee438ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa2b expref: 648 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278768:0:10981:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:3.0:1776187965.278770:0:10981:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1776187965.278772:0:10981:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000900c220d, rc 0) 00000100:00100000:3.0:1776187965.278840:0:10981:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074e0543b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+648:2222:x1862467653374528:12345-192.168.204.20@tcp:101:ll_sa_11304.0 Request processed in 799us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.278848:0:10981:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15206 00000100:00100000:3.0:1776187965.278912:0:10981:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15207 00000100:00100000:3.0:1776187965.278917:0:10981:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd316459 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+647:11304:x1862467653374592:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:3.0:1776187965.278928:0:10981:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187965.278938:0:10981:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438ee0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa32 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278963:0:10981:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee438ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x210:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278969:0:10981:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee438ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.278977:0:10981:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee438ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187965.278996:0:10981:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x210:0x0]: returning size 11776 00000004:00200000:3.0:1776187965.278998:0:10981:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187965.279006:0:10981:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee438ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.279015:0:10981:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438ee0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa32 expref: 649 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.279022:0:10981:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee438ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa32 expref: 648 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.279026:0:10981:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x0 (00000000eec748e5) 00010000:00010000:3.0:1776187965.279027:0:10981:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1776187965.279029:0:10981:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000052d92773, rc 0) 00000100:00100000:3.0:1776187965.279045:0:10981:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd316459 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+648:11304:x1862467653374592:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 127us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.279050:0:10981:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15207 00000100:00100000:2.0:1776187965.286281:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653374848 00000100:00100000:2.0:1776187965.286356:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15208 00000100:00100000:2.0:1776187965.286375:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d242284 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+648:11303:x1862467653374848:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.286466:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.286496:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000572c369a/0x92b1eb87ee424141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x238:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3e4c expref: 648 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286531:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003998f131/0x92b1eb87ee41f09e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x238:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21f1 expref: 647 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286547:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000067d9528/0x92b1eb87ee4241b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x238:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3e76 expref: 646 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286558:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000c81e15f/0x92b1eb87ee41f082 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x238:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21e3 expref: 645 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286568:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x238:0x0].0x0 (0000000027f37f26) 00010000:00010000:2.0:1776187965.286578:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.286608:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438eee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x234:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286629:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286639:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286654:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438ef5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x234:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286661:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x234:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286667:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x234:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286800:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438efc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x238:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286809:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438efc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x238:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.286816:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438efc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x238:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.287288:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].373, 64 off32128 00000040:00080000:2.0:1776187965.287317:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4621, 184 off812296 00010000:00010000:2.0:1776187965.288325:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438f03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x238:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288342:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x238:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288350:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x238:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288358:0:5516:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438f03 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x238:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288450:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438f03 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x238:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288458:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee438f03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x238:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288483:0:5516:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.288508:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007d242284 reply state 000000009806d454 transno 4294974863 ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee438efc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x238:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288564:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288570:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438eee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288577:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438eee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288583:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089fb6120 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.288587:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438eee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288594:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438eee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288609:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x234:0x0].0x0 (0000000044964d16) 00010000:00010000:2.0:1776187965.288612:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.288616:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438eee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.288622:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438eee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x234:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.288631:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007d242284 reply state 000000009806d454 transno 4294974863 ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee438ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x234:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.289026:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d242284 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+646:11303:x1862467653374848:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2659us (2946us total) trans 4294974863 rc 0/0 00000100:00100000:2.0:1776187965.289036:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15208 00000100:00100000:2.0:1776187965.313420:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653374976 00000100:00100000:2.0:1776187965.313488:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4336 00000100:00100000:2.0:1776187965.313497:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000579b6adf pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+647:11303:x1862467653374976:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.313783:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000579b6adf pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+648:11303:x1862467653374976:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 286us (523us total) trans 4294974864 rc 0/0 00000100:00100000:2.0:1776187965.313793:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4336 00000100:00100000:2.0:1776187965.322344:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.325659:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.331258:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.331604:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653375360 00000100:00100000:2.0:1776187965.331672:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15210 00000100:00100000:2.0:1776187965.331680:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000098b87e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+645:11368:x1862467653375360:12345-192.168.204.20@tcp:101:ll_sa_11304.0 00010000:00010000:2.0:1776187965.331726:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187965.331751:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438f26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x210:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa39 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.331795:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa39 expref: 646 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.331809:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa39 expref: 646 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.331817:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x0 (00000000eec748e5) 00010000:00010000:2.0:1776187965.331820:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.331823:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000089fb6120, rc 0) 00000100:00100000:2.0:1776187965.331916:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000098b87e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+646:11368:x1862467653375360:12345-192.168.204.20@tcp:101:ll_sa_11304.0 Request processed in 236us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187965.331924:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15210 00000100:00100000:2.0:1776187965.333002:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.336597:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653375488 00010000:00010000:2.0:1776187965.347435:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee438f11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x234:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347458:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee438f11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x234:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347465:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee438f11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x234:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347470:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000862e8a84 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.347474:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee438f11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x234:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347482:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee438f11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x234:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347498:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x234:0x0].0xeff62052 (000000003dd9608e) 00010000:00010000:2.0:1776187965.347501:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.347505:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee438f11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x234:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347510:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee438f11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x234:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347535:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee438f18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347541:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee438f18 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347547:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee438f18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347552:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.347554:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee438f18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347559:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee438f18 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347566:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x236:0x0].0x0 (000000000f84370d) 00010000:00010000:2.0:1776187965.347568:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187965.347570:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee438f18 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.347575:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee438f18 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x236:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.350732:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.350775:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.350796:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.350825:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000004:00200000:0.0:1776187965.351473:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187965.351507:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee438f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351518:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee438f3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351524:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee438f3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351530:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee438f3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351536:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a152635 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.351539:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee438f3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351545:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee438f3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351558:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:0.0:1776187965.351561:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.351564:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee438f3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351570:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee438f3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351581:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee438f42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351586:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee438f42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351592:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee438f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351597:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007072c805 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.351599:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee438f42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351604:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee438f42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351611:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x46e192ec (000000004c664cf8) 00010000:00010000:0.0:1776187965.351613:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.351614:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee438f42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351619:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee438f42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351645:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee438f34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa40 expref: 645 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351656:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee438f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa40 expref: 644 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351662:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23b:0x0].0x0 (000000000554bd3e) 00010000:00010000:0.0:1776187965.351664:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1776187965.351665:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000089ca4280, rc 0) 00000100:00100000:0.0:1776187965.351729:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006117bfa8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+644:2225:x1862467653375552:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 580us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187965.351737:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15212 00000100:00100000:0.0:1776187965.351758:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15213 00000100:00100000:0.0:1776187965.351762:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000817e4933 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+643:2225:x1862467653375616:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:0.0:1776187965.351770:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187965.351778:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee438f50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa47 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351802:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee438f57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351809:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee438f57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351815:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee438f57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351825:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee438f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351831:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee438f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351836:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee438f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351921:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee438f65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351931:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee438f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351938:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee438f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1776187965.351964:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20f:0x0]: returning size 11776 00000004:00200000:0.0:1776187965.351966:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187965.351979:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee438f65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351987:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee438f57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351992:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee438f57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.351998:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee438f57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352004:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.352006:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee438f57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352012:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee438f57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352020:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:0.0:1776187965.352022:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.352024:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee438f57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352029:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee438f57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352039:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee438f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352044:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee438f5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352050:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee438f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352055:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b23405f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.352056:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee438f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352062:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee438f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352069:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0xddbda88f (00000000298f4138) 00010000:00010000:0.0:1776187965.352071:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.352073:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee438f5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352079:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee438f5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352100:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee438f50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa47 expref: 645 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352108:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee438f65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa47 expref: 644 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352119:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000fd67caeb) 00010000:00010000:0.0:1776187965.352122:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1776187965.352123:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a9283777, rc 0) 00000100:00100000:0.0:1776187965.352144:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000817e4933 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+644:2225:x1862467653375616:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 381us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187965.352150:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15213 00000100:00100000:0.0:1776187965.352163:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15214 00000100:00100000:0.0:1776187965.352167:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ba04817 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+643:2225:x1862467653375680:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:0.0:1776187965.352174:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187965.352181:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438f6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa4e expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352202:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438f73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352210:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438f73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352215:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438f73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352236:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352243:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352253:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352297:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438f81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352306:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352312:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1776187965.352484:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20a:0x0]: returning size 11776 00000004:00200000:0.0:1776187965.352487:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187965.352505:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438f81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352514:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438f73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352520:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438f73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352525:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438f73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352530:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d042148c already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.352532:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438f73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352542:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438f73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352549:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:0.0:1776187965.352552:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.352554:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438f73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352559:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee438f73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352568:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352572:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438f7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352578:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352583:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc9474fb already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.352585:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352590:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438f7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352596:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0xc144154 (00000000a7c2e43a) 00010000:00010000:0.0:1776187965.352598:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.352600:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438f7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352606:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352625:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438f6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa4e expref: 645 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352635:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438f81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa4e expref: 644 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.352641:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x0 (00000000c45808c0) 00010000:00010000:0.0:1776187965.352643:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1776187965.352645:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004fba2add, rc 0) 00000100:00100000:0.0:1776187965.352666:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ba04817 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+644:2225:x1862467653375680:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 499us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187965.352673:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15214 00000100:00100000:3.0:1776187965.353391:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653375744 00000100:00100000:3.0:1776187965.353433:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4338 00000100:00100000:3.0:1776187965.353438:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000630996cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+644:11303:x1862467653375744:12345-192.168.204.20@tcp:37:dbench.0 00000100:00100000:2.0:1776187965.354921:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653375808 00000100:00100000:2.0:1776187965.354967:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4339 00000100:00100000:2.0:1776187965.354974:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+645:11368:x1862467653375808:12345-192.168.204.20@tcp:37:ll_sa_11304.0 00000100:00100000:2.0:1776187965.363341:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+645:11368:x1862467653375808:12345-192.168.204.20@tcp:37:ll_sa_11304.0 Request processed in 8355us (8807us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187965.363360:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4339 00000100:00100000:2.0:1776187965.373267:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000630996cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+644:11303:x1862467653375744:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 19819us (22433us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187965.373285:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4338 00000100:00100000:2.0:1776187965.374111:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.374306:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653375872 00010000:00010000:3.0:1776187965.374340:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa39 expref: 644 pid: 5516 timeout: 542 lvb_type: 0 00000100:00100000:3.0:1776187965.374379:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4308 00000100:00100000:3.0:1776187965.374385:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e3c369 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+644:2223:x1862467653375872:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187965.374399:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187965.374404:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa39 expref: 644 pid: 5516 timeout: 542 lvb_type: 0 00010000:00010000:3.0:1776187965.374415:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa39 expref: 644 pid: 5516 timeout: 542 lvb_type: 0 00010000:00010000:3.0:1776187965.374433:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee438f26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa39 expref: 644 pid: 5516 timeout: 542 lvb_type: 0 00010000:00010000:3.0:1776187965.374447:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x0 (00000000eec748e5) 00010000:00010000:3.0:1776187965.374451:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.374461:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.374468:0:7121:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.374499:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187965.374531:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e3c369 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+643:2223:x1862467653375872:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 146us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.374537:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4308 00010000:00010000:2.0:1776187965.374681:0:5515:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.374689:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.374711:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.374720:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.374727:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.374828:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x211:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.374835:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.374845:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.375517:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].376, 64 off32320 00000040:00080000:2.0:1776187965.375539:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4623, 184 off812664 00010000:00010000:2.0:1776187965.375605:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee438f96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x211:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375617:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee438f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375626:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee438f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375632:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee438f96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375638:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee438f96 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375643:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee438f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x211:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375730:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.375751:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d76a0226 reply state 00000000d8d3785f transno 4294974867 ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x211:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375798:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375809:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375814:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375821:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000059fd37 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.375826:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375833:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375842:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x0 (00000000eec748e5) 00010000:00010000:2.0:1776187965.375845:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.375848:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.375853:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee438f2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.375861:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d76a0226 reply state 00000000d8d3785f transno 4294974867 ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.375976:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d76a0226 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+644:11304:x1862467653375488:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 35437us (43111us total) trans 4294974867 rc 0/0 00000100:00100000:2.0:1776187965.375984:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15211 00010000:00010000:0.0:1776187965.376734:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.376737:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.376739:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187965.397576:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.397626:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187965.398551:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398568:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398576:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398582:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.398587:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398595:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398610:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x6428115e (000000007e00579b) 00010000:00010000:3.0:1776187965.398613:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.398618:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398624:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee438f88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398643:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398649:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398655:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398661:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000597b6781 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.398663:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398668:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398676:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x211:0x0].0x0 (000000007659c27e) 00010000:00010000:3.0:1776187965.398678:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.398680:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.398685:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee438f8f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x211:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.399055:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653376064 00000100:00100000:0.0:1776187965.399091:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15215 00000100:00100000:0.0:1776187965.399097:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000805b708d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+644:11370:x1862467653376064:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:0.0:1776187965.399111:0:5515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187965.399128:0:5515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438f9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa55 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.399171:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa55 expref: 645 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.399184:0:5515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa55 expref: 645 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.399191:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26d:0x0].0x0 (000000001ecff654) 00010000:00010000:0.0:1776187965.399193:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.399195:0:5515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000095ae11d5, rc 0) 00000100:00100000:0.0:1776187965.399246:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000805b708d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+645:11370:x1862467653376064:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 148us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187965.399253:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15215 00000100:00100000:2.0:1776187965.406469:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.407394:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.407487:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.409013:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653376320 00000100:00100000:0.0:1776187965.409073:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15216 00000100:00100000:0.0:1776187965.409079:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b53874c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+648:11303:x1862467653376320:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187965.409124:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1776187965.409159:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002a08b20f/0x92b1eb87ee42759e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4f7f expref: 648 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.409184:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000dba8aac/0x92b1eb87ee42063f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2acd expref: 647 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.409197:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059f4931e/0x92b1eb87ee42760e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4fa9 expref: 646 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.409208:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000000a57082/0x92b1eb87ee420615 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2abf expref: 645 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.409218:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26f:0x0].0x0 (00000000bf296021) 00010000:00010000:0.0:1776187965.409245:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000053723fa5/0x92b1eb87ee438e31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa16 expref: 644 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.409253:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26d:0x0].0x0 (000000001ecff654) 00010000:00010000:0.0:1776187965.409256:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187965.409282:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.409296:0:12471:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438f9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa55 expref: 643 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.409302:0:12471:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.409337:0:12471:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438f9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa55 expref: 643 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.409348:0:12471:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee438f9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa55 expref: 643 pid: 5515 timeout: 542 lvb_type: 0 00000100:00100000:0.0:1776187965.409360:0:12471:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000579b6adf pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12471:1862467659896320:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187965.412337:0:12471:0:(client.c:2500:ptlrpc_set_wait()) set 0000000069643cf6 going to sleep for 43 seconds 00000100:00100000:0.0:1776187965.418524:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.419256:0:12471:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000579b6adf pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12471:1862467659896320:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187965.419282:0:12471:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.419356:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653376512 00000100:00100000:3.0:1776187965.419502:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15217 00000100:00100000:3.0:1776187965.419508:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f4d060e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+643:11304:x1862467653376512:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187965.419564:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187965.419586:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d82639ac/0x92b1eb87ee4381e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca618 expref: 643 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419604:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c20c0380/0x92b1eb87ee43721c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca0f4 expref: 642 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419615:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000013e2656c/0x92b1eb87ee43820d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca626 expref: 641 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419625:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee436ea3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9fdc expref: 640 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419635:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37c:0x0].0x0 (000000008d2350fb) 00010000:00010000:3.0:1776187965.419646:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187965.419683:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419711:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419721:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419736:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419743:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419748:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419860:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419870:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.419914:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187965.420289:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].375, 64 off32256 00000040:00080000:3.0:1776187965.420313:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4624, 184 off812848 00010000:00010000:3.0:1776187965.420608:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438fc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420621:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420629:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420637:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438fc0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420643:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438fc0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420649:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee438fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420668:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187965.420758:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001f4d060e reply state 00000000cd61e034 transno 4294974870 ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420812:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420824:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420831:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420837:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009372d704 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.420841:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420848:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420858:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x0 (00000000eec748e5) 00010000:00010000:3.0:1776187965.420861:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.420864:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.420870:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187965.420903:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001f4d060e reply state 00000000cd61e034 transno 4294974870 ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.420965:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f4d060e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+640:11304:x1862467653376512:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1455us (2449us total) trans 4294974870 rc 0/0 00000100:00100000:3.0:1776187965.420974:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15217 00000100:00100000:3.0:1776187965.432389:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653376640 00000100:00100000:3.0:1776187965.432432:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4343 00000100:00100000:3.0:1776187965.432437:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+639:11304:x1862467653376640:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187965.432715:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+640:11304:x1862467653376640:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 276us (1380us total) trans 4294974871 rc 0/0 00000100:00100000:3.0:1776187965.432722:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4343 00010000:00010000:3.0:1776187965.434709:0:12471:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.434728:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.434762:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.434776:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.434789:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.434933:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 3/0,1 mode: --/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.434941:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.434947:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187965.435320:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].377, 64 off32384 00000040:00080000:3.0:1776187965.435341:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4625, 184 off813032 00010000:00010000:3.0:1776187965.435621:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee438fd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435632:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee438fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435640:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee438fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435647:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee438fd5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435653:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee438fd5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435659:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee438fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435678:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187965.435696:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b53874c1 reply state 000000008b680cb7 transno 4294974872 ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435737:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435742:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435747:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435758:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc9474fb already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.435762:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435768:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435779:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26d:0x0].0x0 (000000001ecff654) 00010000:00010000:3.0:1776187965.435781:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.435784:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.435789:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee438fa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x26d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187965.435797:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b53874c1 reply state 000000008b680cb7 transno 4294974872 ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.435901:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b53874c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+641:11303:x1862467653376320:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 26819us (28506us total) trans 4294974872 rc 0/0 00000100:00100000:3.0:1776187965.435910:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15216 00010000:00010000:2.0:1776187965.436178:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436186:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436192:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436197:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e57fe368 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.436199:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436204:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436212:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0xa36e7a4 (00000000adef1ff2) 00010000:00010000:2.0:1776187965.436214:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.436216:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436232:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee438fb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436251:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436257:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436262:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436267:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000547596a2 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.436268:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436273:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436279:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37c:0x0].0x0 (0000000015f09a80) 00010000:00010000:2.0:1776187965.436281:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187965.436282:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.436287:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee438fb9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447477:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447509:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447519:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447528:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007a73b3e2 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.447533:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447542:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447567:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26d:0x0].0xdde1c156 (000000004e9c3dd8) 00010000:00010000:3.0:1776187965.447570:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.447575:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447581:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee438fc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26d:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447605:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447611:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447616:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447621:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000072a961c9 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.447623:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447628:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447646:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26f:0x0].0x0 (00000000a528b82c) 00010000:00010000:3.0:1776187965.447649:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.447651:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 2/0,0 mode: --/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.447657:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee438fce lrc: 0/0,0 mode: --/EX res: [0x200000401:0x26f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.450078:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653376768 00000100:00100000:2.0:1776187965.450169:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4344 00000100:00100000:2.0:1776187965.450177:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8bb2b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+639:11303:x1862467653376768:12345-192.168.204.20@tcp:37:dbench.0 00000100:00100000:3.0:1776187965.450712:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653376832 00000100:00100000:3.0:1776187965.450766:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653376896 00000100:00100000:3.0:1776187965.450790:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15218 00000100:00100000:3.0:1776187965.450797:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000801ad508 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+641:2225:x1862467653376832:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:3.0:1776187965.450822:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187965.450852:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa5c expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.452626:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee438fff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.452643:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee438fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.452655:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee438fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.452830:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.452840:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.452849:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.453021:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43900d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.453032:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43900d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.453039:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43900d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187965.454655:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x243:0x0]: returning size 12800 00000004:00200000:3.0:1776187965.454662:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000100:00100000:2.0:1776187965.454944:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000004:00010000:3.0:1776187965.455630:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43900d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455653:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee438fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455660:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee438fff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455666:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee438fff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455677:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ba32a0cd already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.455682:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee438fff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455696:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee438fff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455716:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:3.0:1776187965.455719:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.455725:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee438fff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455732:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee438fff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455748:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455755:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439006 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455760:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455766:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000056c4f2e0 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.455767:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455773:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455781:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x56ca4f59 (0000000004f0a071) 00010000:00010000:3.0:1776187965.455784:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.455787:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439006 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455792:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455840:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee438fdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa5c expref: 644 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455856:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43900d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa5c expref: 643 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.455864:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:3.0:1776187965.455866:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1776187965.455868:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac819bc1, rc 0) 00000100:00100000:3.0:1776187965.455984:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000801ad508 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+643:2225:x1862467653376832:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 5186us (5982us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.455993:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15218 00000100:00100000:2.0:1776187965.461891:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8bb2b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+638:11303:x1862467653376768:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 11688us (11925us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187965.461913:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4344 00010000:00010000:0.0:1776187965.464133:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187965.464147:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439029 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.464163:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000787789d5 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187965.464167:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439029 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.464178:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439029 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.464198:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x219:0x0].0x0 (00000000f056c6a6) 00010000:00010000:0.0:1776187965.464201:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187965.464206:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439029 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.464213:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439029 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x219:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.464249:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.464251:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.464252:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.470507:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43901b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470536:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43901b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470543:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43901b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470551:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.470556:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43901b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470570:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43901b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470592:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0xc3d50206 (00000000e5f011d9) 00010000:00010000:3.0:1776187965.470595:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.470601:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43901b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470607:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43901b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470635:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439022 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470641:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439022 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470647:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439022 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470652:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0ab918b already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.470654:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439022 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.470659:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439022 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.471205:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x219:0x0].0x0 (00000000f056c6a6) 00010000:00010000:3.0:1776187965.471210:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.471214:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439022 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.471231:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439022 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x219:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.476719:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187965.478851:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187965.478858:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439045 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x388:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.478866:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187965.478869:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439045 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x388:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.478915:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439045 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x388:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.478931:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x388:0x0].0x0 (000000006c0357c0) 00010000:00010000:2.0:1776187965.478934:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187965.478938:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439045 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x388:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.478945:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439045 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x388:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.478959:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.478960:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.478962:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187965.479551:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.480211:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653377280 00000100:00100000:2.0:1776187965.480290:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4345 00000100:00100000:2.0:1776187965.480299:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d5ae8b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+638:11303:x1862467653377280:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.481428:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d5ae8b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+640:11303:x1862467653377280:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 1127us (1880us total) trans 4294974875 rc 0/0 00000100:00100000:2.0:1776187965.481441:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4345 00000100:00100000:2.0:1776187965.482435:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.482604:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653377344 00000100:00100000:3.0:1776187965.482676:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15222 00000100:00100000:3.0:1776187965.482683:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd3821b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+640:11372:x1862467653377344:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:3.0:1776187965.482716:0:5517:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187965.482743:0:5517:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43904c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa6a expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.482789:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43904c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa6a expref: 641 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.482806:0:5517:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43904c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa6a expref: 641 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.482816:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:3.0:1776187965.482819:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.482823:0:5517:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009372d704, rc 0) 00000100:00100000:3.0:1776187965.482900:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd3821b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+641:11372:x1862467653377344:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 216us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.482908:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15222 00000100:00100000:0.0:1776187965.500025:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.500125:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653377472 00000100:00100000:0.0:1776187965.500193:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.500198:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4346 00000100:00100000:2.0:1776187965.500206:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ec38c77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+640:11304:x1862467653377472:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.500560:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ec38c77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+640:11304:x1862467653377472:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 354us (549us total) trans 4294974876 rc 0/0 00000100:00100000:2.0:1776187965.500568:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4346 00010000:00010000:3.0:1776187965.500959:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439037 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.500986:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439037 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.500995:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439037 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501002:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d26d87db already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.501006:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439037 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501013:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439037 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501030:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0xe7aaf970 (000000007616c5c6) 00010000:00010000:3.0:1776187965.501033:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.501037:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439037 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501043:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439037 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501065:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43903e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x388:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501070:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43903e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x388:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501075:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43903e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x388:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501080:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c460bc60 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.501081:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43903e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x388:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501088:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43903e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x388:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501095:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x388:0x0].0x0 (000000006c0357c0) 00010000:00010000:3.0:1776187965.501097:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.501099:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43903e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x388:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.501104:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43903e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x388:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.512678:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.512782:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653377664 00000100:00100000:0.0:1776187965.512858:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4347 00000100:00100000:0.0:1776187965.512866:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d287c27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+636:11372:x1862467653377664:12345-192.168.204.20@tcp:37:ll_sa_11303.0 00000100:00100000:2.0:1776187965.520654:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.520808:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653377792 00000100:00100000:0.0:1776187965.520954:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15224 00000100:00100000:0.0:1776187965.520964:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000217ef172 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+637:11304:x1862467653377792:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187965.521072:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187965.521124:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e9c59029/0x92b1eb87ee436c5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x216:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9f49 expref: 637 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521161:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000078ffce25/0x92b1eb87ee422755 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x216:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c35d2 expref: 636 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521176:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee422794 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x216:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c35f5 expref: 635 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521190:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000a9c3b05/0x92b1eb87ee41e2eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x216:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c5d expref: 634 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521203:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x216:0x0].0x0 (0000000038ac37ce) 00010000:00010000:0.0:1776187965.521217:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187965.521273:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43905a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521297:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43905a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521309:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43905a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521326:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439061 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x210:0x0].0xf4ed591 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521333:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521338:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521483:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439068 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x216:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521492:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439068 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.521498:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439068 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x216:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187965.522060:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].377, 64 off32384 00000040:00080000:0.0:1776187965.522090:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4628, 184 off813584 00010000:00010000:0.0:1776187965.522171:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x216:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522185:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522195:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522204:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522211:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522230:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522267:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.522292:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000217ef172 reply state 0000000047475257 transno 4294974877 ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439068 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x216:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522323:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187965.522329:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522337:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187965.522340:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522348:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522360:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x216:0x0].0x0 (00000000298f4138) 00010000:00010000:0.0:1776187965.522364:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187965.522368:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522374:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43906f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x216:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522389:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.522391:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.522392:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.522440:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43905a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522452:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43905a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522458:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43905a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522463:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d042148c already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.522466:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43905a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522471:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43905a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522479:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x0 (00000000eec748e5) 00010000:00010000:0.0:1776187965.522481:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.522483:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43905a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.522488:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43905a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.522496:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000217ef172 reply state 0000000047475257 transno 4294974877 ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.522622:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000217ef172 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+635:11304:x1862467653377792:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1655us (1974us total) trans 4294974877 rc 0/0 00000100:00100000:0.0:1776187965.522632:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15224 00000100:00100000:3.0:1776187965.534073:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.549184:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.552401:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653378048 00000100:00100000:3.0:1776187965.552494:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15225 00000100:00100000:3.0:1776187965.552504:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002be731d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+634:11304:x1862467653378048:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187965.555088:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187965.555150:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007b055464/0x92b1eb87ee437422 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x218:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca19c expref: 634 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555186:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503f3dae/0x92b1eb87ee422954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x218:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3681 expref: 633 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555207:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000263d4ed6/0x92b1eb87ee42299a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x218:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3696 expref: 632 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555232:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfe20f16/0x92b1eb87ee41e3a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x218:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1caa expref: 631 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555252:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x218:0x0].0x0 (000000004d4b78c7) 00010000:00010000:3.0:1776187965.555264:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187965.555314:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439076 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555337:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439076 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555349:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439076 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555368:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555375:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555381:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555514:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x218:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555524:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.555543:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187965.556078:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].378, 64 off32448 00000040:00080000:3.0:1776187965.556104:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4629, 176 off813760 00010000:00010000:3.0:1776187965.556185:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x218:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556197:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556207:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556215:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556230:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556237:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556254:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187965.556277:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002be731d9 reply state 00000000885254d8 transno 4294974879 ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x218:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556335:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439076 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556341:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439076 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556353:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439076 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556360:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000056c4f2e0 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.556364:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439076 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556372:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439076 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556384:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x0 (00000000eec748e5) 00010000:00010000:3.0:1776187965.556387:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.556390:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439076 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.556395:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439076 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x210:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187965.556403:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002be731d9 reply state 00000000885254d8 transno 4294974879 ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.556515:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002be731d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+632:11304:x1862467653378048:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 4009us (7341us total) trans 4294974879 rc 0/0 00000100:00100000:3.0:1776187965.556528:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15225 00000100:00100000:2.0:1776187965.556772:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187965.557436:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187965.557444:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.557458:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007a73b3e2 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187965.557462:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.557471:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.557484:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x218:0x0].0x0 (00000000a528b82c) 00010000:00010000:0.0:1776187965.557486:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187965.557488:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.557494:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43908b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x218:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.557510:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.557512:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.557513:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187965.557971:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653378112 00010000:00010000:3.0:1776187965.558469:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43904c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa6a expref: 632 pid: 5517 timeout: 542 lvb_type: 0 00000100:00100000:3.0:1776187965.558625:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4310 00000100:00100000:3.0:1776187965.558634:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000630996cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+632:2223:x1862467653378112:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187965.558652:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187965.558659:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43904c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa6a expref: 632 pid: 5517 timeout: 542 lvb_type: 0 00010000:00010000:3.0:1776187965.558673:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43904c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa6a expref: 632 pid: 5517 timeout: 542 lvb_type: 0 00010000:00010000:3.0:1776187965.558695:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43904c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa6a expref: 632 pid: 5517 timeout: 542 lvb_type: 0 00010000:00010000:3.0:1776187965.558710:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:3.0:1776187965.558715:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.558727:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.558737:0:7121:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.558778:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187965.558840:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000630996cd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+631:2223:x1862467653378112:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 206us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.558847:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4310 00010000:00010000:0.0:1776187965.558927:0:6573:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.558938:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.558969:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.558981:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.558990:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.559160:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.559166:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.559174:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187965.559693:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].379, 64 off32512 00000040:00080000:0.0:1776187965.559719:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4630, 184 off813944 00010000:00010000:0.0:1776187965.559803:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.559816:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.559826:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.559833:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.559839:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.559850:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.559869:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.559929:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000b2735b0 reply state 00000000d3dcd283 transno 4294974880 ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.559996:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.560003:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.560011:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.560016:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c48750ea already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.560021:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.560027:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.560039:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:0.0:1776187965.560042:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.560045:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.560051:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439053 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.560062:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000b2735b0 reply state 00000000d3dcd283 transno 4294974880 ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.560161:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b2735b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+632:11303:x1862467653377600:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 59708us (59966us total) trans 4294974880 rc 0/0 00000100:00100000:0.0:1776187965.560172:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15223 00010000:00010000:2.0:1776187965.560697:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187965.560706:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.560716:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005f47f5e7 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187965.560720:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.560726:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.560739:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21f:0x0].0x0 (000000000f4996f9) 00010000:00010000:2.0:1776187965.560741:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187965.560743:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.560749:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4390a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.560766:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.560767:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.560769:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.561331:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561343:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561349:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561355:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ba32a0cd already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.561358:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561365:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561375:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x469e1765 (0000000004f0a071) 00010000:00010000:0.0:1776187965.561378:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.561380:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561386:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43907d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561405:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561411:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561416:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561421:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000072a961c9 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.561423:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561428:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561435:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x218:0x0].0x0 (00000000a528b82c) 00010000:00010000:0.0:1776187965.561437:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187965.561439:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.561444:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439084 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x218:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.570862:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653378240 00000100:00100000:2.0:1776187965.570962:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4349 00000100:00100000:2.0:1776187965.570973:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+631:11304:x1862467653378240:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.571358:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+632:11304:x1862467653378240:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 384us (806us total) trans 4294974881 rc 0/0 00000100:00100000:2.0:1776187965.571368:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4349 00010000:00010000:3.0:1776187965.572818:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.572843:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.572852:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.572859:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d042148c already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.572864:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.573413:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.573443:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0xb65fef2a (000000004c664cf8) 00010000:00010000:3.0:1776187965.573446:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.573452:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.573458:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439092 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.573486:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.573492:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.573498:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.573510:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.573513:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.573519:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.573527:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21f:0x0].0x0 (000000000f4996f9) 00010000:00010000:3.0:1776187965.573529:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.574716:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.574735:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee439099 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.576862:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.578955:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187965.597475:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187965.597494:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee4390bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.597519:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187965.597523:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee4390bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.597609:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee4390bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.597633:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x214:0x0].0x0 (00000000889219c6) 00010000:00010000:0.0:1776187965.597636:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187965.597641:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee4390bc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.597647:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee4390bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x214:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.597665:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.597667:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.597668:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187965.597773:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.602727:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.602773:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.602844:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653378752 00010000:00010000:3.0:1776187965.602936:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4390ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x210:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.602957:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15227 00010000:00010000:3.0:1776187965.602962:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4390ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.602973:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031e08482 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+631:2225:x1862467653378752:12345-192.168.204.20@tcp:101:ll_sa_11304.0 00010000:00010000:3.0:1776187965.602984:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4390ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.602994:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d719b35a already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.602998:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4390ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.603006:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4390ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x210:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603014:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187965.603026:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0xe5dc7a0b (00000000194664fe) 00010000:00010000:3.0:1776187965.603031:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.603036:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4390ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.603042:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4390ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x210:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603043:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4390c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa71 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.603074:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4390b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.603083:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4390b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.603089:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4390b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.603094:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9325880 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.603096:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4390b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.603102:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4390b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.603110:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x214:0x0].0x0 (00000000889219c6) 00010000:00010000:3.0:1776187965.603113:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.603115:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4390b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.603125:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4390b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x214:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603141:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4390ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603160:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4390ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603173:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4390ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603188:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4390d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603195:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4390d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603201:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4390d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603358:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee4390d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603369:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee4390d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603376:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee4390d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1776187965.603535:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23c:0x0]: returning size 11776 00000004:00200000:0.0:1776187965.603541:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187965.603583:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee4390d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603597:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4390ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603604:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4390ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603610:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4390ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603616:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a152635 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.603619:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4390ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603626:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4390ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603638:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:0.0:1776187965.603641:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.603644:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4390ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603650:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4390ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603664:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4390d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603670:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4390d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603677:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4390d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603683:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.603685:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4390d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603692:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4390d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603699:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x46e192ec (000000007f00126a) 00010000:00010000:0.0:1776187965.603701:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.603703:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4390d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603709:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4390d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603752:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4390c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa71 expref: 632 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603765:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee4390d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa71 expref: 631 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.603772:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0x0 (00000000e23ff234) 00010000:00010000:0.0:1776187965.603774:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1776187965.603777:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004e168beb, rc 0) 00000100:00100000:0.0:1776187965.603870:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031e08482 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+631:2225:x1862467653378752:12345-192.168.204.20@tcp:101:ll_sa_11304.0 Request processed in 903us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187965.603919:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15227 00000100:00100000:0.0:1776187965.609199:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.614468:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653378816 00000100:00100000:0.0:1776187965.618698:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653378880 00000100:00100000:0.0:1776187965.618795:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15228 00000100:00100000:0.0:1776187965.618804:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9bff62c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+634:11303:x1862467653378624:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187965.619906:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187965.619951:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fb24b4da/0x92b1eb87ee4307d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c81f9 expref: 633 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.619983:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bfb6ca28/0x92b1eb87ee4235f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3aa2 expref: 632 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.620001:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fb74f770/0x92b1eb87ee42363c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3abe expref: 631 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.620028:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000069254e86/0x92b1eb87ee41eaee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fa5 expref: 630 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.620040:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22a:0x0].0x0 (000000002cd5fee4) 00010000:00010000:0.0:1776187965.620054:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187965.620102:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4390df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.620122:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4390df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.620135:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4390df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.620158:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.620165:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.620173:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.620182:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a1171d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+629:11304:x1862467653378688:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 16093us (17462us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187965.620197:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4351 00010000:00010000:0.0:1776187965.620338:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.620347:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.620354:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187965.621268:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].380, 64 off32576 00000040:00080000:0.0:1776187965.621300:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4632, 184 off814304 00010000:00010000:0.0:1776187965.621391:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.621403:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.621418:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.621443:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.621451:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.621458:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.621483:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.621508:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c9bff62c reply state 00000000ff57f9ba transno 4294974884 ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.621533:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187965.621538:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.621545:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005f47f5e7 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187965.621550:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622319:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622332:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22a:0x0].0x0 (000000000f4996f9) 00010000:00010000:0.0:1776187965.622346:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187965.622350:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622360:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439109 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622374:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.622375:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.622377:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.622434:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4390df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622442:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4390df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622447:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4390df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622452:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005ac9bdea already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.622454:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4390df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622460:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4390df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622467:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:0.0:1776187965.622469:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.622471:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4390df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622476:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4390df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.622489:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c9bff62c reply state 00000000ff57f9ba transno 4294974884 ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.622583:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9bff62c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+630:11303:x1862467653378624:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3779us (24814us total) trans 4294974884 rc 0/0 00000100:00100000:0.0:1776187965.622592:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15228 00000100:00100000:0.0:1776187965.622658:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15230 00000100:00100000:0.0:1776187965.622665:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016508e55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+629:2225:x1862467653378816:12345-192.168.204.20@tcp:101:ll_sa_11304.0 00010000:00010000:0.0:1776187965.622682:0:5517:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187965.622697:0:5517:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439117 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa78 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622746:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43911e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622759:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43911e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622769:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43911e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622785:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622792:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622803:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622922:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43912c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x209:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622933:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43912c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.622940:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43912c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1776187965.623078:0:5517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x209:0x0]: returning size 11776 00000004:00200000:0.0:1776187965.623081:0:5517:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187965.623105:0:5517:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43912c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623115:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43911e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623120:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43911e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623125:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43911e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623131:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000af78cd92 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.623133:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43911e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623144:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43911e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623154:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:0.0:1776187965.623156:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.623159:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43911e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623165:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43911e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623174:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623179:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439125 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623185:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623190:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.623192:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623197:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623204:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0xc144154 (000000004c664cf8) 00010000:00010000:0.0:1776187965.623206:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.623208:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439125 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623214:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623256:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa78 expref: 631 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623266:0:5517:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43912c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa78 expref: 630 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.623273:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x0 (00000000be4d8ce3) 00010000:00010000:0.0:1776187965.623275:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1776187965.623277:0:5517:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cc9474fb, rc 0) 00000100:00100000:0.0:1776187965.623310:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016508e55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+630:2225:x1862467653378816:12345-192.168.204.20@tcp:101:ll_sa_11304.0 Request processed in 645us (14281us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187965.623317:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15230 00000100:00100000:3.0:1776187965.631507:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.647510:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653379136 00000100:00100000:3.0:1776187965.647613:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4353 00000100:00100000:3.0:1776187965.647624:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8978d09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+631:11303:x1862467653379136:12345-192.168.204.20@tcp:35:dbench.0 00010000:00010000:0.0:1776187965.649070:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187965.649078:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439148 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.649091:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187965.649096:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439148 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.649105:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439148 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.649124:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x251:0x0].0x0 (000000003d48dd25) 00010000:00010000:0.0:1776187965.649131:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187965.649135:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439148 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.649148:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439148 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x251:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.649175:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.649177:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.649179:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.649843:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649854:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649860:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649866:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.649869:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649906:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649920:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x801dd473 (00000000219adb48) 00010000:00010000:2.0:1776187965.649922:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.649924:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649929:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4390e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649948:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649954:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649960:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649966:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d042148c already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.649968:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649973:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649980:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22a:0x0].0x0 (000000000f4996f9) 00010000:00010000:2.0:1776187965.649982:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187965.649985:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.649995:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4390ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.650119:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8978d09 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+628:11303:x1862467653379136:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 2486us (2700us total) trans 4294974886 rc 0/0 00000100:00100000:3.0:1776187965.650137:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4353 00010000:00010000:3.0:1776187965.654109:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43913a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654131:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43913a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654140:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43913a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654148:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.654153:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43913a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654166:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43913a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654196:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0xc3f00931 (0000000077c38ae7) 00010000:00010000:3.0:1776187965.654199:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.654204:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43913a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654211:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43913a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654254:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439141 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654260:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439141 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654266:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439141 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654271:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4841773 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.654273:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439141 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654279:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439141 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.654298:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187965.654306:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x251:0x0].0x0 (000000003d48dd25) 00010000:00010000:3.0:1776187965.654313:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.654315:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439141 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.654322:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439141 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x251:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.654541:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653379392 00000100:00100000:2.0:1776187965.654615:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4354 00000100:00100000:2.0:1776187965.654624:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eacafe27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+627:11304:x1862467653379392:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.654977:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eacafe27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+628:11304:x1862467653379392:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 353us (698us total) trans 4294974888 rc 0/0 00000100:00100000:2.0:1776187965.654987:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4354 00000100:00100000:3.0:1776187965.658446:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.658535:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653379520 00000100:00100000:2.0:1776187965.658626:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15232 00000100:00100000:2.0:1776187965.658634:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd00cbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+628:11303:x1862467653379520:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.658714:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.658756:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000041bd0ca0/0x92b1eb87ee4306d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x226:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c81a5 expref: 628 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.658787:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a835ce1/0x92b1eb87ee423421 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x226:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3a0f expref: 627 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.658801:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bb16a0a9/0x92b1eb87ee423452 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x226:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3a2b expref: 626 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.658816:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d83ff4c5/0x92b1eb87ee41e96d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x226:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1efd expref: 625 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.658827:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x226:0x0].0x0 (0000000071617847) 00010000:00010000:2.0:1776187965.658841:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.658920:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43914f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.658943:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43914f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.658955:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43914f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.658974:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439156 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21b:0x0].0xd60b5417 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.658982:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439156 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.658989:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439156 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.659143:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43915d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x226:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.659152:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43915d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.659159:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43915d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x226:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.659662:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].381, 64 off32640 00000040:00080000:2.0:1776187965.659691:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4634, 184 off814672 00010000:00010000:2.0:1776187965.659769:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x226:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.659780:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.659788:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.659797:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.659803:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.659808:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.661381:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.661433:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005fd00cbd reply state 00000000f3e9b0d6 transno 4294974889 ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43915d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x226:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.661533:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43914f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.661541:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43914f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.661548:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43914f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.661555:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.661559:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43914f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.661567:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43914f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.661591:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:0.0:1776187965.661594:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.661600:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43914f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.661605:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43914f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.661615:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005fd00cbd reply state 00000000f3e9b0d6 transno 4294974889 ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439156 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.661751:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd00cbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+626:11303:x1862467653379520:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3113us (3308us total) trans 4294974889 rc 0/0 00000100:00100000:0.0:1776187965.661762:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15232 00010000:00010000:2.0:1776187965.661859:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187965.661866:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.661906:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025e5acf1 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187965.661910:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.661918:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.661933:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x226:0x0].0x0 (0000000090869b29) 00010000:00010000:2.0:1776187965.661936:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187965.661940:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.661946:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439164 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x226:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.661963:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.661966:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.661969:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187965.666816:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653379648 00000100:00100000:2.0:1776187965.666923:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15233 00000100:00100000:2.0:1776187965.666932:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ccb7994 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+625:11304:x1862467653379648:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.667027:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.667058:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c9cbdabb/0x92b1eb87ee4273c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26c:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4ee5 expref: 625 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.667084:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000024f35a0c/0x92b1eb87ee4204ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a5d expref: 624 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.667098:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004c19cac8/0x92b1eb87ee427408 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4f01 expref: 623 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.667110:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f01b1c81/0x92b1eb87ee4204d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a48 expref: 622 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.667119:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26c:0x0].0x0 (00000000d761de5c) 00010000:00010000:2.0:1776187965.667130:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187965.669352:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000040:00080000:0.0:1776187965.669869:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].382, 64 off32704 00000040:00080000:0.0:1776187965.669922:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4635, 184 off814856 00010000:00010000:0.0:1776187965.670021:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439180 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670039:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439180 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670050:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439180 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670058:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439180 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670068:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439180 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670074:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439180 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670096:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.670118:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007ccb7994 reply state 0000000090dbe1a2 transno 4294974890 ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439179 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670171:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43916b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670178:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43916b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670184:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43916b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670190:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006aa2e88c already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.670193:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43916b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670200:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43916b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670212:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:0.0:1776187965.670225:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.670230:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43916b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.670235:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43916b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.670244:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007ccb7994 reply state 0000000090dbe1a2 transno 4294974890 ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.670329:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ccb7994 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+623:11304:x1862467653379648:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3397us (4978us total) trans 4294974890 rc 0/0 00000100:00100000:0.0:1776187965.670339:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15233 00010000:00010000:0.0:1776187965.674080:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439172 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674107:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439172 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674114:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439172 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674120:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.674124:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439172 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674131:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439172 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674147:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x21e72734 (00000000889219c6) 00010000:00010000:0.0:1776187965.674150:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.674155:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439172 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674161:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439172 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674182:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439179 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674188:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439179 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x26c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674193:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439179 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674197:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.674199:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439179 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674204:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439179 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x26c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674211:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26c:0x0].0x0 (00000000194664fe) 00010000:00010000:0.0:1776187965.674213:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187965.674224:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439179 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x26c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.674230:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439179 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x26c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.675421:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.678209:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653379776 00000100:00100000:2.0:1776187965.678289:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4355 00000100:00100000:2.0:1776187965.678298:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9511a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+622:11303:x1862467653379776:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187965.678459:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653379904 00000100:00100000:3.0:1776187965.678499:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4356 00000100:00100000:3.0:1776187965.678503:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000812af665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+623:11304:x1862467653379904:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187965.678757:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000812af665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+624:11304:x1862467653379904:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 252us (3342us total) trans 4294974891 rc 0/0 00000100:00100000:3.0:1776187965.678764:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4356 00000100:00100000:2.0:1776187965.679752:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9511a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+624:11303:x1862467653379776:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 1450us (10404us total) trans 4294974892 rc 0/0 00000100:00100000:2.0:1776187965.679762:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4355 00000100:00100000:0.0:1776187965.683054:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.685644:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.687481:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653380032 00000100:00100000:2.0:1776187965.687551:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653380160 00000100:00100000:2.0:1776187965.687585:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15234 00000100:00100000:2.0:1776187965.687592:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009cb0b41d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+625:11304:x1862467653380032:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.687646:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.687675:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d25c5107/0x92b1eb87ee42a5da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x249:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c610d expref: 625 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687711:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003a74b020/0x92b1eb87ee4250d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x249:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4377 expref: 624 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687722:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cafb3ad5/0x92b1eb87ee42514e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x249:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c439a expref: 623 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687732:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a1b50ba9/0x92b1eb87ee41f77b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x249:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2498 expref: 622 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687741:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x249:0x0].0x0 (000000007ab75ba6) 00010000:00010000:2.0:1776187965.687750:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.687779:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439187 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687793:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687802:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687815:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687821:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687827:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687973:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x249:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687981:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.687988:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.690297:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].382, 64 off32704 00000040:00080000:2.0:1776187965.690314:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4637, 184 off815224 00010000:00010000:2.0:1776187965.690779:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee4391b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x249:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.690795:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee4391b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.690804:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee4391b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.690812:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee4391b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.690818:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee4391b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.690824:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee4391b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x249:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.690849:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.690972:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009cb0b41d reply state 00000000021221a4 transno 4294974894 ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x249:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.691020:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.691026:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439187 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.691032:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.691037:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025e5acf1 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.691041:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.691047:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439187 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.691062:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:2.0:1776187965.691065:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.691068:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439187 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.691074:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439187 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.691083:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009cb0b41d reply state 00000000021221a4 transno 4294974894 ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.691179:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009cb0b41d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+620:11304:x1862467653380032:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3585us (8131us total) trans 4294974894 rc 0/0 00000100:00100000:2.0:1776187965.691188:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15234 00010000:00010000:2.0:1776187965.693121:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4391a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693141:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4391a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693148:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4391a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693154:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d719b35a already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.693158:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4391a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693165:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4391a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693179:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x5a3b2e4f (000000006c0357c0) 00010000:00010000:2.0:1776187965.693182:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.693185:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4391a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693191:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4391a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693210:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee4391aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693228:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee4391aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693234:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee4391aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693240:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c48750ea already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.693242:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee4391aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693247:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee4391aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693255:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x221:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187965.693258:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187965.693260:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee4391aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.693269:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee4391aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x221:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.696792:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.696811:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.696817:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.696823:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000791f3e8c already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.696827:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.696834:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.696851:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0xca0b3ea (0000000079764c80) 00010000:00010000:3.0:1776187965.696853:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.697133:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.697142:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43918e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.697165:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.697171:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.697176:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.697181:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009d004fc already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.697182:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.697187:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.697195:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x249:0x0].0x0 (0000000090869b29) 00010000:00010000:3.0:1776187965.697197:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.697199:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.697208:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439195 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x249:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.701069:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.702261:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.706510:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4357 00000100:00100000:2.0:1776187965.706518:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071bce4b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+619:11304:x1862467653380288:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.706790:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071bce4b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+620:11304:x1862467653380288:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 271us (5729us total) trans 4294974895 rc 0/0 00000100:00100000:2.0:1776187965.706798:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4357 00000100:00100000:2.0:1776187965.706818:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4358 00000100:00100000:2.0:1776187965.706823:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000401d7a29 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+619:11303:x1862467653380416:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.706943:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000401d7a29 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+620:11303:x1862467653380416:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 119us (4688us total) trans 4294974896 rc 0/0 00000100:00100000:2.0:1776187965.706949:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4358 00000100:00100000:0.0:1776187965.710132:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653380544 00000100:00100000:0.0:1776187965.710197:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15236 00000100:00100000:0.0:1776187965.710203:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9fb81cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+620:11303:x1862467653380544:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187965.710267:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187965.710295:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ea9e670a/0x92b1eb87ee43144b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c862f expref: 620 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710318:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d8af3cef/0x92b1eb87ee422c9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3799 expref: 619 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710330:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd6159f0/0x92b1eb87ee422cc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c37a7 expref: 618 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710341:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000325182bb/0x92b1eb87ee41e5e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21d:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d8a expref: 617 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710352:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21d:0x0].0x0 (000000003c3c0cad) 00010000:00010000:0.0:1776187965.710366:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187965.710398:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4391bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710413:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4391bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710422:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4391bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710441:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710448:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710455:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710557:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710565:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.710572:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.711366:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.711592:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653380672 00000100:00100000:3.0:1776187965.711640:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15237 00000100:00100000:3.0:1776187965.711645:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020025a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+617:11304:x1862467653380672:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187965.711702:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187965.711722:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c7e60634/0x92b1eb87ee42b0f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c6543 expref: 617 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.711740:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a236bf87/0x92b1eb87ee4256f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c456f expref: 616 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.711753:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003f8f8343/0x92b1eb87ee425736 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4592 expref: 615 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.711763:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000011b5f07/0x92b1eb87ee41f9c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2594 expref: 614 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.711771:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24f:0x0].0x0 (000000004d709dc2) 00010000:00010000:3.0:1776187965.711778:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187965.711797:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee4391d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.711809:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee4391d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.711817:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee4391d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.711828:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4391db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0x17d46a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.711834:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4391db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.711839:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4391db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.712336:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee4391e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.712345:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee4391e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.712351:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee4391e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187965.713598:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].383, 64 off32768 00000040:00080000:0.0:1776187965.713627:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4638, 184 off815408 00000040:00080000:3.0:1776187965.714155:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].384, 64 off32832 00000040:00080000:3.0:1776187965.714175:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4639, 184 off815592 00010000:00010000:3.0:1776187965.714252:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4391e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714271:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4391e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714282:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4391e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714291:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4391e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714298:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4391e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714304:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4391e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714320:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187965.714342:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000020025a1b reply state 00000000695f23e5 transno 4294974898 ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee4391e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714410:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee4391d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714416:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee4391d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714423:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee4391d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714429:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009372d704 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.714434:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee4391d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714442:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee4391d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714454:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:3.0:1776187965.714457:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.714462:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee4391d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.714468:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee4391d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187965.714478:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000020025a1b reply state 00000000695f23e5 transno 4294974898 ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4391db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.714588:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020025a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+616:11304:x1862467653380672:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2939us (3222us total) trans 4294974898 rc 0/0 00000100:00100000:3.0:1776187965.714597:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15237 00010000:00010000:0.0:1776187965.716059:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4391f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716081:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4391f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716090:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4391f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716103:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4391f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716108:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4391f0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716113:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4391f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716127:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.716144:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c9fb81cc reply state 000000008361a0f5 transno 4294974897 ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716192:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4391bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716199:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4391bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716204:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4391bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716209:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.716212:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4391bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716234:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4391bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716250:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:0.0:1776187965.716252:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.716255:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4391bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.716260:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4391bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.716268:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c9fb81cc reply state 000000008361a0f5 transno 4294974897 ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.716362:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9fb81cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+616:11303:x1862467653380544:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 6147us (6767us total) trans 4294974897 rc 0/0 00000100:00100000:0.0:1776187965.716370:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15236 00010000:00010000:0.0:1776187965.719686:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719701:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719707:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719713:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000af78cd92 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.719715:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719720:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719729:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0xbfd87aeb (000000004c664cf8) 00010000:00010000:0.0:1776187965.719731:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.719733:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719739:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719751:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719757:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719762:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719767:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005ac9bdea already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.719768:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719773:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719778:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21d:0x0].0x0 (000000007f00126a) 00010000:00010000:0.0:1776187965.719780:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187965.719782:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.719791:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.727117:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.727302:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653380800 00000100:00100000:3.0:1776187965.727354:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4359 00000100:00100000:3.0:1776187965.727362:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d64e5f0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+614:11303:x1862467653380800:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187965.727805:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d64e5f0c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+615:11303:x1862467653380800:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 441us (694us total) trans 4294974899 rc 0/0 00000100:00100000:3.0:1776187965.727814:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4359 00000100:00100000:2.0:1776187965.733413:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.733467:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.733565:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653381056 00000100:00100000:0.0:1776187965.733634:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15238 00000100:00100000:0.0:1776187965.733641:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010c377d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+615:11303:x1862467653381056:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187965.733709:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187965.733740:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd1ebb0d/0x92b1eb87ee430476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x223:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c80d3 expref: 615 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.733766:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000093093b63/0x92b1eb87ee42311f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x223:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c391a expref: 614 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.733779:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009c94cdc1/0x92b1eb87ee423157 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x223:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c392f expref: 613 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.733791:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008cbb260d/0x92b1eb87ee41e86a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x223:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e94 expref: 612 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.733800:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x223:0x0].0x0 (00000000190bb6d3) 00010000:00010000:0.0:1776187965.733811:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187965.733845:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.733862:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.733871:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.733931:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21b:0x0].0xc5f130b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.733939:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.733945:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734048:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439205 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x223:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734056:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439205 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x223:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734062:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439205 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x223:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187965.734453:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].385, 64 off32896 00000040:00080000:0.0:1776187965.734479:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4640, 184 off815776 00010000:00010000:0.0:1776187965.734544:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43920c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x223:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734554:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43920c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x223:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734562:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43920c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x223:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734574:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43920c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x223:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734581:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43920c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x223:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734587:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43920c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x223:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734602:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.734621:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000010c377d8 reply state 000000003b14c992 transno 4294974900 ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439205 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x223:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734665:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734671:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734677:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734682:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005ac9bdea already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.734686:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734693:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734706:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:0.0:1776187965.734708:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.734711:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.734716:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4391f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.734724:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000010c377d8 reply state 000000003b14c992 transno 4294974900 ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4391fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.734798:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010c377d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+613:11303:x1862467653381056:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1156us (1393us total) trans 4294974900 rc 0/0 00000100:00100000:0.0:1776187965.734806:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15238 00000100:00100000:3.0:1776187965.735032:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653380928 00000100:00100000:3.0:1776187965.735066:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4360 00000100:00100000:3.0:1776187965.735071:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ceb0237 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+613:11304:x1862467653380928:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187965.735188:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ceb0237 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+614:11304:x1862467653380928:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 115us (1721us total) trans 4294974901 rc 0/0 00000100:00100000:3.0:1776187965.735194:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4360 00000100:00100000:2.0:1776187965.740586:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.740666:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653381184 00000100:00100000:3.0:1776187965.740723:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15239 00000100:00100000:3.0:1776187965.740729:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045ecf174 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+614:11304:x1862467653381184:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187965.740786:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187965.740814:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009429eda/0x92b1eb87ee42a651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c613e expref: 614 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.740834:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009abfb927/0x92b1eb87ee4252c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4411 expref: 613 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.740847:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004df35ad1/0x92b1eb87ee425338 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c443b expref: 612 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.740858:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000074ea3ff6/0x92b1eb87ee41f83f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24ec expref: 611 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.740867:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24b:0x0].0x0 (0000000066756068) 00010000:00010000:3.0:1776187965.740911:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187965.741080:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439213 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741096:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439213 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741107:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439213 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741120:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43921a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0xa5e17578 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741127:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43921a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741138:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43921a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741255:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439221 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741264:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439221 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741271:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439221 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187965.741632:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].386, 64 off32960 00000040:00080000:3.0:1776187965.741656:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4641, 184 off815960 00010000:00010000:3.0:1776187965.741716:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439228 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741725:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741732:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439228 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741739:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439228 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741746:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439228 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741756:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439228 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741773:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187965.741790:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000045ecf174 reply state 0000000084e7f7d8 transno 4294974902 ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439221 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741840:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439213 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741846:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439213 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741853:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439213 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741859:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009372d704 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.741862:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439213 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741869:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439213 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741907:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:3.0:1776187965.741910:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.741913:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439213 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.741919:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439213 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187965.746177:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000045ecf174 reply state 0000000084e7f7d8 transno 4294974902 ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43921a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.746312:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045ecf174 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+611:11304:x1862467653381184:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 5578us (5729us total) trans 4294974902 rc 0/0 00000100:00100000:3.0:1776187965.746323:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15239 00000100:00100000:2.0:1776187965.750532:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.750610:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653381312 00000100:00100000:0.0:1776187965.750673:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4361 00000100:00100000:0.0:1776187965.750692:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003469a13f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+611:11303:x1862467653381312:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187965.751944:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003469a13f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+611:11303:x1862467653381312:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 1259us (1417us total) trans 4294974903 rc 0/0 00000100:00100000:0.0:1776187965.751955:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4361 00000100:00100000:2.0:1776187965.758146:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.758232:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.760321:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653381440 00000100:00100000:0.0:1776187965.760369:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4362 00000100:00100000:0.0:1776187965.760375:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071bce4b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+609:11304:x1862467653381440:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187965.760545:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071bce4b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+610:11304:x1862467653381440:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 168us (2408us total) trans 4294974905 rc 0/0 00000100:00100000:0.0:1776187965.760557:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4362 00010000:00010000:3.0:1776187965.762295:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187965.762305:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439244 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.762318:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187965.762321:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439244 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.762330:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439244 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.762347:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x230:0x0].0x0 (00000000e5f011d9) 00010000:00010000:3.0:1776187965.762349:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187965.762353:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439244 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.762358:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439244 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x230:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.762374:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.762376:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.762378:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187965.765264:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.769332:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653381696 00000100:00100000:0.0:1776187965.769397:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15241 00000100:00100000:0.0:1776187965.769404:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000579b6adf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+609:11304:x1862467653381696:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187965.769462:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187965.769482:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006023418d/0x92b1eb87ee42b283 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c65e4 expref: 609 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769500:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000adfaaf85/0x92b1eb87ee4264f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c49eb expref: 608 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769512:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008f57ae63/0x92b1eb87ee426591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4a23 expref: 607 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769523:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000075249b4a/0x92b1eb87ee41ff46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25d:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27ee expref: 606 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769531:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25d:0x0].0x0 (0000000074aaf14c) 00010000:00010000:0.0:1776187965.769538:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187965.769571:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee43924b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769585:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee43924b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769595:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee43924b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769615:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439252 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0x9e362f1b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769622:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769627:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769753:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439259 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769761:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.769767:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187965.770617:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].387, 64 off33024 00000040:00080000:0.0:1776187965.770643:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4643, 184 off816320 00010000:00010000:0.0:1776187965.770716:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770729:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770737:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770749:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770756:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770762:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770802:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.770820:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000579b6adf reply state 0000000001fb9946 transno 4294974906 ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770899:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee43924b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770905:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee43924b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.770910:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187965.770911:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee43924b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.770915:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770916:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005ac9bdea already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.770920:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee43924b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770926:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee43924b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.770931:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000095ae11d5 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187965.770933:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.770939:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770940:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:0.0:1776187965.770943:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.770946:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee43924b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.770947:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25d:0x0].0x0 (00000000a7c2e43a) 00010000:00010000:2.0:1776187965.770949:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187965.770951:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.770952:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee43924b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.770957:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439260 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.770962:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000579b6adf reply state 0000000001fb9946 transno 4294974906 ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.770965:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.770966:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.770967:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187965.771062:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000579b6adf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+607:11304:x1862467653381696:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1655us (5804us total) trans 4294974906 rc 0/0 00000100:00100000:0.0:1776187965.771071:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15241 00000100:00100000:2.0:1776187965.781820:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.785451:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.789826:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.790089:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.790308:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653382144 00000100:00100000:0.0:1776187965.790376:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653382208 00000100:00100000:0.0:1776187965.790396:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15242 00000100:00100000:0.0:1776187965.790402:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9511a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+609:11303:x1862467653382144:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187965.790464:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187965.790493:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006cb41242/0x92b1eb87ee43074e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x228:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c81cf expref: 609 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.790515:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000389ab1ee/0x92b1eb87ee423516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x228:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3a63 expref: 608 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.790526:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ad4bc903/0x92b1eb87ee423540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x228:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3a71 expref: 607 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.790541:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a00509ea/0x92b1eb87ee41ea31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x228:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f4a expref: 606 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.790551:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x228:0x0].0x0 (000000008d403023) 00010000:00010000:0.0:1776187965.790562:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187965.790599:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee439267 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.790613:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee439267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.790622:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee439267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.790634:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.790639:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.790645:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792338:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x228:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792349:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792362:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187965.792712:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].384, 64 off32832 00000040:00080000:0.0:1776187965.792732:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4645, 184 off816688 00010000:00010000:0.0:1776187965.792784:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x228:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792794:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792801:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792807:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792813:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792818:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792836:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.792849:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c9511a11 reply state 00000000ff777f04 transno 4294974910 ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x228:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792908:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee439267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792920:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee439267 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792939:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee439267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792945:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005ac9bdea already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.792947:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee439267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792954:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee439267 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792963:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:0.0:1776187965.792966:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.792969:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee439267 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.792974:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee439267 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.792983:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c9511a11 reply state 00000000ff777f04 transno 4294974910 ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.793566:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9511a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+604:11303:x1862467653382144:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3161us (3748us total) trans 4294974910 rc 0/0 00000100:00100000:0.0:1776187965.793573:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15242 00010000:00010000:0.0:1776187965.794142:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187965.794149:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.794158:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000862e8a84 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187965.794161:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.794169:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.794183:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x228:0x0].0x0 (000000000f84370d) 00010000:00010000:0.0:1776187965.794185:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187965.794188:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.794193:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee439298 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x228:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.794208:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.794209:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.794210:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.798919:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.798952:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.798961:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.798967:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000059fd37 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.798972:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.798979:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.798996:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x1e0192a5 (0000000014211482) 00010000:00010000:0.0:1776187965.798999:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.799003:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.799009:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee43926e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.799033:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.799039:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.799044:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.799049:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.799051:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.799055:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.799062:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x228:0x0].0x0 (000000000f84370d) 00010000:00010000:0.0:1776187965.799065:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187965.799066:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.799071:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439291 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x228:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.803017:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.804572:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.804704:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653382464 00000100:00100000:0.0:1776187965.804754:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4366 00000100:00100000:0.0:1776187965.804759:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f1d31b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+603:11303:x1862467653382464:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187965.804979:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f1d31b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+604:11303:x1862467653382464:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 219us (412us total) trans 4294974912 rc 0/0 00000100:00100000:0.0:1776187965.804986:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4366 00000100:00100000:3.0:1776187965.808859:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.811816:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.823072:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653382592 00000100:00100000:3.0:1776187965.823531:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653382720 00000100:00100000:3.0:1776187965.823656:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15244 00000100:00100000:3.0:1776187965.823665:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006249c4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+605:11303:x1862467653382592:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187965.823759:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187965.823793:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019309ca5/0x92b1eb87ee43089e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c8246 expref: 605 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.823819:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006a5251e4/0x92b1eb87ee4237cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3b3c expref: 604 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.823830:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e19679f1/0x92b1eb87ee423834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3b58 expref: 603 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.823841:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000562e4b88/0x92b1eb87ee41ebb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2000 expref: 602 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.823850:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22c:0x0].0x0 (00000000cbbb5576) 00010000:00010000:3.0:1776187965.823860:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187965.823914:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43929f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.823930:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43929f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.823939:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43929f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.823954:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee4392a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21b:0x0].0xee1a16ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.823961:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee4392a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.823966:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee4392a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824068:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4392ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824076:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4392ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824087:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4392ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187965.824553:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].385, 64 off32896 00000040:00080000:3.0:1776187965.824580:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4646, 184 off816872 00010000:00010000:3.0:1776187965.824672:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4392c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824682:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4392c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824691:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4392c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824699:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4392c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824706:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4392c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824713:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4392c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824736:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187965.824755:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006249c4dd reply state 00000000d858bb1a transno 4294974913 ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4392ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824815:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43929f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824822:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43929f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824829:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43929f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824842:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009372d704 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.824847:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43929f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824857:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43929f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824905:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:3.0:1776187965.824911:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.824914:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43929f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.824932:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43929f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187965.824945:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006249c4dd reply state 00000000d858bb1a transno 4294974913 ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee4392a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.825040:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006249c4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+600:11303:x1862467653382592:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1372us (16188us total) trans 4294974913 rc 0/0 00000100:00100000:3.0:1776187965.825058:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15244 00010000:00010000:3.0:1776187965.828089:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.839592:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4392bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839615:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4392bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839624:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4392bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839632:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c460bc60 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.839636:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4392bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839645:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4392bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839668:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x5e0db83a (00000000f056c6a6) 00010000:00010000:0.0:1776187965.839672:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.839677:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4392bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839691:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4392bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839718:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4392c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839724:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4392c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839730:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4392c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839735:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d26d87db already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.839737:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4392c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839743:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4392c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839751:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x247:0x0].0x0 (00000000e5f011d9) 00010000:00010000:0.0:1776187965.839753:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187965.839755:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4392c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.839775:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4392c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x247:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.842575:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.849200:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.849264:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.849426:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653383104 00000100:00100000:2.0:1776187965.849494:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15246 00000100:00100000:2.0:1776187965.849502:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f4e8b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+599:11304:x1862467653383104:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.849561:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.849588:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000065965b4d/0x92b1eb87ee42b386 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x264:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c6646 expref: 599 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849614:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dc4bd5af/0x92b1eb87ee426baa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x264:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4bf1 expref: 598 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849629:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af5e1f56/0x92b1eb87ee426c21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x264:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4c1b expref: 597 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849642:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007bce4994/0x92b1eb87ee4201ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x264:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28f8 expref: 596 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849653:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x264:0x0].0x0 (000000002336810a) 00010000:00010000:2.0:1776187965.849663:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.849697:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4392d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849713:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4392d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849722:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4392d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849735:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4392de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0x98ca20bd bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849742:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4392de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849747:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4392de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849957:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4392e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x264:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849966:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4392e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.849976:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4392e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x264:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.850517:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].386, 64 off32960 00000040:00080000:2.0:1776187965.850542:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4648, 184 off817240 00010000:00010000:2.0:1776187965.850617:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4392ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x264:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.850628:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4392ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.850638:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4392ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.850647:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4392ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.850653:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4392ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.850658:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4392ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x264:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.850780:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653382976 00000100:00100000:0.0:1776187965.850824:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4368 00000100:00100000:0.0:1776187965.850829:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035ef4933 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+597:11303:x1862467653382976:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187965.851057:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035ef4933 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+598:11303:x1862467653382976:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 222us (1865us total) trans 4294974917 rc 0/0 00000100:00100000:0.0:1776187965.851064:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4368 00010000:00010000:2.0:1776187965.852419:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.852456:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000f4e8b06 reply state 000000003b34bf89 transno 4294974916 ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4392e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x264:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.852521:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4392d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.852528:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4392d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.852535:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4392d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.852542:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025e5acf1 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.852546:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4392d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.852554:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4392d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.852568:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:2.0:1776187965.852570:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.852574:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4392d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.852579:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4392d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.852589:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000f4e8b06 reply state 000000003b34bf89 transno 4294974916 ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4392de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.852679:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f4e8b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+598:11304:x1862467653383104:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3173us (3412us total) trans 4294974916 rc 0/0 00000100:00100000:2.0:1776187965.852688:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15246 00000100:00100000:0.0:1776187965.858311:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.858390:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653383232 00000100:00100000:2.0:1776187965.858443:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15247 00000100:00100000:2.0:1776187965.858450:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eacafe27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+598:11303:x1862467653383232:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.858514:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.858541:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f7921dde/0x92b1eb87ee430ce9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x232:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c83b2 expref: 598 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858562:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ff6356ff/0x92b1eb87ee423d3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x232:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3d0a expref: 597 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858575:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d1614e59/0x92b1eb87ee423ddd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x232:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3d26 expref: 596 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858585:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f9ee7cac/0x92b1eb87ee41ede9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x232:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20e7 expref: 595 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858598:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x232:0x0].0x0 (00000000453c4f3b) 00010000:00010000:2.0:1776187965.858608:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.858642:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4392f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858658:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4392f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858671:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4392f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858685:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4392fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21b:0x0].0xcbe2ca0f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858691:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4392fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858697:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4392fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858828:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439301 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x232:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858836:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439301 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.858843:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439301 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x232:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.859266:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].387, 64 off33024 00000040:00080000:2.0:1776187965.859292:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4649, 184 off817424 00010000:00010000:2.0:1776187965.859359:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x232:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859368:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x232:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859376:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x232:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859383:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x232:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859388:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x232:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859394:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x232:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859423:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.859441:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000eacafe27 reply state 000000008fecbf8e transno 4294974918 ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439301 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x232:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859488:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4392f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859495:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4392f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859501:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4392f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859507:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.859510:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4392f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859517:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4392f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859530:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:2.0:1776187965.859533:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.859536:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4392f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.859542:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4392f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.859550:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000eacafe27 reply state 000000008fecbf8e transno 4294974918 ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4392fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.859636:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eacafe27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+596:11303:x1862467653383232:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1184us (1331us total) trans 4294974918 rc 0/0 00000100:00100000:2.0:1776187965.859645:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15247 00010000:00010000:3.0:1776187965.860603:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187965.860610:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x232:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.860620:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8111509 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187965.860622:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x232:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.860629:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x232:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.860641:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x232:0x0].0x0 (0000000021698773) 00010000:00010000:3.0:1776187965.860644:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187965.860647:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x232:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.860653:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439308 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x232:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.860665:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.860667:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.860668:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187965.867093:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.869252:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653383360 00000100:00100000:3.0:1776187965.869329:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4369 00000100:00100000:3.0:1776187965.869338:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000812af665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+594:11303:x1862467653383360:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187965.869609:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000812af665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+595:11303:x1862467653383360:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 270us (2521us total) trans 4294974919 rc 0/0 00000100:00100000:3.0:1776187965.869617:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4369 00000100:00100000:0.0:1776187965.870593:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.878442:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.878595:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653383616 00000100:00100000:2.0:1776187965.878655:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15248 00000100:00100000:2.0:1776187965.878661:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006a1171d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+596:11303:x1862467653383616:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.878738:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.878773:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000096bc6e8e/0x92b1eb87ee430d44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c83d5 expref: 596 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.878798:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000001b07721/0x92b1eb87ee4239d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3bdd expref: 595 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.878810:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee423a2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3c00 expref: 594 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.878827:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b2a79d9c/0x92b1eb87ee41ec6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2046 expref: 593 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.878837:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22e:0x0].0x0 (000000007c24abf5) 00010000:00010000:2.0:1776187965.878847:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.878915:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43930f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.878930:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43930f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.878939:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43930f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.878954:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.878961:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.878979:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.879099:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.879108:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.879118:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.879529:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].388, 64 off33088 00000040:00080000:2.0:1776187965.879552:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4650, 184 off817608 00010000:00010000:2.0:1776187965.879616:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.879627:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.879636:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.879643:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.879650:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.879656:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.881846:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.882601:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006a1171d1 reply state 00000000b39f90cb transno 4294974921 ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.883280:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43930f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.883297:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43930f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.883306:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43930f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.883313:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.883318:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43930f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.883326:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43930f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.883346:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:2.0:1776187965.883349:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.883354:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43930f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.883359:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43930f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.883369:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006a1171d1 reply state 00000000b39f90cb transno 4294974921 ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.883503:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a1171d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+594:11303:x1862467653383616:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 4838us (5068us total) trans 4294974921 rc 0/0 00000100:00100000:2.0:1776187965.883515:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15248 00010000:00010000:3.0:1776187965.888705:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187965.888719:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.888737:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c8d05e already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187965.888741:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.888750:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.888768:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22e:0x0].0x0 (0000000063901265) 00010000:00010000:3.0:1776187965.888771:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187965.888776:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.888783:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439324 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.888802:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.888803:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.888805:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187965.889057:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.889729:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653383744 00000100:00100000:2.0:1776187965.889803:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15249 00000100:00100000:2.0:1776187965.889811:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d5ae8b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+594:11304:x1862467653383744:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.889869:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.889954:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fb319519/0x92b1eb87ee42b1e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x257:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c65a5 expref: 594 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.889977:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ef423a9/0x92b1eb87ee425f24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x257:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c481d expref: 593 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.889990:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000068d1ee3/0x92b1eb87ee425f7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x257:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4847 expref: 592 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890002:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000211c8497/0x92b1eb87ee41fcd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x257:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26e4 expref: 591 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890013:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x257:0x0].0x0 (00000000ea60b11e) 00010000:00010000:2.0:1776187965.890021:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.890057:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43932b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890072:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43932b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890081:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43932b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890096:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890102:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890108:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890236:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x257:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890244:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890251:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x257:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.890618:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].390, 64 off33216 00000040:00080000:2.0:1776187965.890752:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4651, 184 off817792 00010000:00010000:2.0:1776187965.890816:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439340 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x257:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890827:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890836:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439340 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890842:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439340 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890849:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439340 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.890858:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439340 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x257:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.891187:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.891207:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006d5ae8b2 reply state 00000000b3137541 transno 4294974922 ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.891287:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43932b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.891294:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43932b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.891300:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43932b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.891305:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001be7b27e already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.891308:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43932b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.891315:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43932b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.891325:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:2.0:1776187965.891327:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.891330:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43932b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.891336:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43932b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.891345:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006d5ae8b2 reply state 00000000b3137541 transno 4294974922 ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.891607:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d5ae8b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+592:11304:x1862467653383744:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1794us (2552us total) trans 4294974922 rc 0/0 00000100:00100000:2.0:1776187965.891617:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15249 00010000:00010000:3.0:1776187965.893056:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893073:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893080:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893086:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025e5acf1 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.893089:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893096:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893111:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x10cfb8f0 (000000001efc7c4f) 00010000:00010000:3.0:1776187965.893113:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.893118:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893123:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439316 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21b:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893142:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893149:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893154:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893159:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006b72ffb6 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.893161:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893166:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893172:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22e:0x0].0x0 (0000000063901265) 00010000:00010000:3.0:1776187965.893175:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.893177:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.893182:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43931d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.896470:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.896717:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653383808 00000100:00100000:3.0:1776187965.896776:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4371 00000100:00100000:3.0:1776187965.896784:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7db6af8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+591:11303:x1862467653383808:12345-192.168.204.20@tcp:37:dbench.0 00010000:00010000:2.0:1776187965.897753:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897770:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897778:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897785:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002df099c7 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.897789:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897795:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897810:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x51a4c572 (00000000780f5f5c) 00010000:00010000:2.0:1776187965.897813:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.897818:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897823:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439332 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897840:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897846:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897852:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897857:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.897859:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897865:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897888:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x257:0x0].0x0 (0000000021698773) 00010000:00010000:2.0:1776187965.897891:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187965.897894:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.897899:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439339 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x257:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.899298:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.901311:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653383936 00000100:00100000:2.0:1776187965.901371:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4372 00000100:00100000:2.0:1776187965.901377:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006538300c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+592:11304:x1862467653383936:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.901771:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006538300c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+593:11304:x1862467653383936:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 385us (2471us total) trans 4294974923 rc 0/0 00000100:00100000:2.0:1776187965.901782:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4372 00000100:00100000:0.0:1776187965.908102:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.908238:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653384064 00000100:00100000:2.0:1776187965.908290:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15250 00000100:00100000:2.0:1776187965.908298:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ec38c77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+591:11304:x1862467653384064:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.908360:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.908390:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b2df9c4e/0x92b1eb87ee426edd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x268:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4d1e expref: 591 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908411:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002801a7ac/0x92b1eb87ee420359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x268:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29a7 expref: 590 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908423:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b5e0a0c/0x92b1eb87ee426f3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x268:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4d3a expref: 589 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908434:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce013aff/0x92b1eb87ee42032f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x268:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2999 expref: 588 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908443:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x268:0x0].0x0 (00000000392ad8cf) 00010000:00010000:2.0:1776187965.908453:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.908485:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439347 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908500:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439347 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908509:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439347 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908526:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908533:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908538:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908641:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x268:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908649:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.908656:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.909085:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].389, 64 off33152 00000004:00080000:2.0:1776187965.909093:0:5515:0:(osp_sync.c:1658:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 442893217871ns, next at 443893214894ns, rc = 0 00000040:00080000:2.0:1776187965.909113:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4652, 184 off817976 00010000:00010000:2.0:1776187965.909178:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x268:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909187:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909196:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909208:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909226:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909232:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909258:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.909279:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007ec38c77 reply state 00000000bcaa6a6e transno 4294974924 ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x268:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909339:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439347 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909345:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439347 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909353:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439347 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909359:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.909363:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439347 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909370:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439347 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909383:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:2.0:1776187965.909386:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.909389:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439347 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.909395:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439347 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.909404:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007ec38c77 reply state 00000000bcaa6a6e transno 4294974924 ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.909507:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ec38c77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+589:11304:x1862467653384064:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1207us (1411us total) trans 4294974924 rc 0/0 00000100:00100000:2.0:1776187965.909515:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15250 00010000:00010000:3.0:1776187965.909775:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187965.909780:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.909787:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187965.909790:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.909796:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.909806:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x268:0x0].0x0 (000000007e00579b) 00010000:00010000:3.0:1776187965.909808:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187965.909810:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.909815:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43935c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x268:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.909829:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.909830:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.909831:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187965.923161:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923188:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923197:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923204:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002df099c7 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.923208:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923224:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923242:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0xbea011c (00000000780f5f5c) 00010000:00010000:3.0:1776187965.923246:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.923250:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923255:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43934e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923275:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923281:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923286:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923291:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001be7b27e already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.923293:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923298:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923306:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x268:0x0].0x0 (000000007e00579b) 00010000:00010000:3.0:1776187965.923308:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.923310:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.923314:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439355 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x268:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.926206:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.928256:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653384320 00000100:00100000:3.0:1776187965.928326:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4373 00000100:00100000:3.0:1776187965.928333:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000812af665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+588:11303:x1862467653384320:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187965.928569:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000812af665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+589:11303:x1862467653384320:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 235us (2373us total) trans 4294974925 rc 0/0 00000100:00100000:3.0:1776187965.928577:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4373 00000100:00100000:3.0:1776187965.928994:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.929237:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653384192 00000100:00100000:2.0:1776187965.929278:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4374 00000100:00100000:2.0:1776187965.929284:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d058849 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+589:11304:x1862467653384192:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.929417:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d058849 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+590:11304:x1862467653384192:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 132us (425us total) trans 4294974926 rc 0/0 00000100:00100000:2.0:1776187965.929424:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4374 00000100:00100000:0.0:1776187965.938160:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.938227:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187965.941122:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.942716:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43936a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23b:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942736:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43936a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942743:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43936a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942750:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0ab918b already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.942755:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43936a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942763:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43936a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942778:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23b:0x0].0x77103a66 (000000007842f307) 00010000:00010000:2.0:1776187965.942782:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.942786:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43936a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x23b:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942793:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43936a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23b:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942815:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439371 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942820:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439371 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942826:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439371 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942832:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.942834:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439371 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942839:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439371 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942847:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x240:0x0].0x0 (00000000f54f0a62) 00010000:00010000:2.0:1776187965.942849:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187965.942851:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439371 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.942856:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439371 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x240:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944533:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944552:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439386 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944559:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944571:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c460bc60 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.944575:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944582:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439386 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944599:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0xf2061246 (000000008d2350fb) 00010000:00010000:3.0:1776187965.944602:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.944607:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439386 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944614:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439386 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944646:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43938d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944652:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43938d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944658:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43938d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944662:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.944664:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43938d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944669:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43938d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944677:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x260:0x0].0x0 (00000000e5f011d9) 00010000:00010000:3.0:1776187965.944682:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.944684:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43938d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.944690:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43938d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x260:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.945569:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.954947:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653384832 00000100:00100000:2.0:1776187965.954995:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4376 00000100:00100000:2.0:1776187965.955001:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e9a71b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+584:11304:x1862467653384832:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187965.955229:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e9a71b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+585:11304:x1862467653384832:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 227us (915us total) trans 4294974930 rc 0/0 00000100:00100000:2.0:1776187965.955238:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4376 00000100:00100000:0.0:1776187965.955990:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653384960 00000100:00100000:0.0:1776187965.956042:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15253 00000100:00100000:0.0:1776187965.956047:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005134e194 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+585:11303:x1862467653384960:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187965.956088:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187965.956115:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005520c58b/0x92b1eb87ee4350a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x241:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9881 expref: 585 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956143:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000085a1a96d/0x92b1eb87ee424a16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x241:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4147 expref: 584 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956153:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eb3ec47d/0x92b1eb87ee424a5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x241:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4163 expref: 583 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956164:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d8a19dd5/0x92b1eb87ee41f456 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x241:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2364 expref: 582 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956172:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x241:0x0].0x0 (00000000b7eb0a40) 00010000:00010000:0.0:1776187965.956180:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187965.956206:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee43939b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956233:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee43939b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956242:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee43939b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956255:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956261:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956266:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956376:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x241:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956383:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.956390:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187965.957022:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].391, 64 off33280 00000040:00080000:0.0:1776187965.957048:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4655, 184 off818528 00010000:00010000:0.0:1776187965.957116:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x241:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957127:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957136:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957143:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957150:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957156:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957274:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.957302:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005134e194 reply state 000000001df942f0 transno 4294974931 ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x241:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957358:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee43939b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957364:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee43939b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957371:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee43939b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957376:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.957381:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee43939b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957388:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee43939b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957400:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23b:0x0].0x0 (000000000554bd3e) 00010000:00010000:0.0:1776187965.957402:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.957405:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee43939b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.957411:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee43939b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.957419:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005134e194 reply state 000000001df942f0 transno 4294974931 ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.957520:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005134e194 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+583:11303:x1862467653384960:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1470us (3065us total) trans 4294974931 rc 0/0 00000100:00100000:0.0:1776187965.957528:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15253 00010000:00010000:3.0:1776187965.959454:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187965.959463:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.959478:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005ac9bdea already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187965.959482:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.959493:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.959510:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x241:0x0].0x0 (0000000014211482) 00010000:00010000:3.0:1776187965.959512:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187965.959516:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.959521:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4393b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x241:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.960266:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653385088 00000100:00100000:2.0:1776187965.960323:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15254 00000100:00100000:2.0:1776187965.960329:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b5402d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+583:11304:x1862467653385088:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187965.960397:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187965.960417:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000629193bd/0x92b1eb87ee42b1b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x255:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c6590 expref: 583 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960435:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004c60f543/0x92b1eb87ee425cca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x255:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4767 expref: 582 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960445:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000488d338d/0x92b1eb87ee425d6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x255:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4783 expref: 581 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960460:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d32e2f05/0x92b1eb87ee41fc13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x255:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2690 expref: 580 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960469:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x255:0x0].0x0 (00000000e3ea3a19) 00010000:00010000:2.0:1776187965.960476:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187965.960512:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee4393b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960528:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee4393b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960538:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee4393b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960553:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960560:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960566:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960668:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x255:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960675:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.960697:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187965.961052:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].392, 64 off33344 00000040:00080000:2.0:1776187965.961072:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4656, 184 off818712 00010000:00010000:2.0:1776187965.961128:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x255:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961136:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961143:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961150:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961155:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961159:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961177:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187965.961192:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001b5402d7 reply state 000000004f88efdd transno 4294974932 ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x255:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961224:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187965.961229:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961235:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187965.961238:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961244:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961252:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x255:0x0].0x0 (00000000d80c9c1b) 00010000:00010000:2.0:1776187965.961255:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187965.961257:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961262:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4393cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x255:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961272:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.961273:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.961274:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.961312:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee4393b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961319:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee4393b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961324:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee4393b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961329:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187965.961332:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee4393b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961337:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee4393b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961344:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:2.0:1776187965.961346:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187965.961348:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee4393b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.961353:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee4393b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187965.961360:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001b5402d7 reply state 000000004f88efdd transno 4294974932 ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.961439:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b5402d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+581:11304:x1862467653385088:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1108us (1502us total) trans 4294974932 rc 0/0 00000100:00100000:2.0:1776187965.961448:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15254 00010000:00010000:3.0:1776187965.961823:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961831:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961837:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961842:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000059fd37 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.961845:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961849:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961859:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23b:0x0].0xc4fc354d (000000000f84370d) 00010000:00010000:3.0:1776187965.961862:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.961864:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961869:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4393a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23b:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961910:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961916:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961921:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961929:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000862e8a84 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.961931:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961936:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961943:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x241:0x0].0x0 (0000000014211482) 00010000:00010000:3.0:1776187965.961945:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.961946:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.961951:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4393a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x241:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964134:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964153:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964159:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964165:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001be7b27e already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.964169:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964175:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964190:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x2ee4e5f8 (000000007659c27e) 00010000:00010000:3.0:1776187965.964193:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.964196:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964202:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee4393be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964229:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964235:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964240:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964246:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002df099c7 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.964248:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964253:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964259:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x255:0x0].0x0 (00000000d80c9c1b) 00010000:00010000:3.0:1776187965.964261:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.964263:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.964272:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee4393c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x255:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.965094:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653385216 00000100:00100000:3.0:1776187965.965142:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4377 00000100:00100000:3.0:1776187965.965149:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db601997 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+579:11303:x1862467653385216:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187965.965422:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db601997 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+580:11303:x1862467653385216:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 272us (652us total) trans 4294974933 rc 0/0 00000100:00100000:3.0:1776187965.965430:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4377 00010000:00010000:0.0:1776187965.967061:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.967067:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.967068:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187965.969143:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187965.969250:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653385344 00000100:00100000:0.0:1776187965.969317:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4378 00000100:00100000:0.0:1776187965.969324:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b5b3a1d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+580:11304:x1862467653385344:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187965.970114:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b5b3a1d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+581:11304:x1862467653385344:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 787us (979us total) trans 4294974934 rc 0/0 00000100:00100000:0.0:1776187965.970126:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4378 00000100:00100000:0.0:1776187965.972767:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653385472 00000100:00100000:0.0:1776187965.972830:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653385600 00000100:00100000:0.0:1776187965.972852:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15255 00000100:00100000:0.0:1776187965.972860:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8ea53aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+582:11303:x1862467653385472:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187965.972967:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187965.973000:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee432e14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c8e16 expref: 582 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973028:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001ada2f4f/0x92b1eb87ee42475a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4052 expref: 581 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973047:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001535081d/0x92b1eb87ee4247b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4067 expref: 580 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973063:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000559a453c/0x92b1eb87ee41f2c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22b5 expref: 579 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973072:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23e:0x0].0x0 (00000000ef4fabf9) 00010000:00010000:0.0:1776187965.973083:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187965.973119:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4393d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973135:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4393d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973145:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4393d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973161:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973168:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973174:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973300:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973307:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973318:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187965.973712:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].392, 64 off33344 00000040:00080000:0.0:1776187965.973735:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4657, 176 off818888 00010000:00010000:0.0:1776187965.973803:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973813:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973820:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973827:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973834:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973839:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973870:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.973914:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f8ea53aa reply state 0000000044ce44ed transno 4294974935 ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.973953:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187965.973960:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973963:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4393d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.973977:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a152635 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187965.973982:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973985:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4393d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.973998:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.973998:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4393d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974006:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.974012:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4393d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.974017:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23e:0x0].0x0 (00000000a7c2e43a) 00010000:00010000:0.0:1776187965.974020:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4393d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.974022:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187965.974025:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.974033:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4393e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974033:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23b:0x0].0x0 (000000000554bd3e) 00010000:00010000:0.0:1776187965.974038:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.974042:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4393d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974050:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4393d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.974053:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.974055:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.974058:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1776187965.974063:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f8ea53aa reply state 0000000044ce44ed transno 4294974935 ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.974166:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8ea53aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+580:11303:x1862467653385472:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1304us (1667us total) trans 4294974935 rc 0/0 00000100:00100000:0.0:1776187965.974175:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15255 00000100:00100000:0.0:1776187965.974204:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15256 00000100:00100000:0.0:1776187965.974222:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000813fe89a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+579:11304:x1862467653385600:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187965.974256:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187965.974270:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd8e3bd3/0x92b1eb87ee42b03e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c64fd expref: 579 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974284:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a9d24ed9/0x92b1eb87ee427202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4e4b expref: 578 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974297:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003c9b0cf3/0x92b1eb87ee42725d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4e75 expref: 577 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974309:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c8a8e4ca/0x92b1eb87ee42040f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29f4 expref: 576 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974316:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26a:0x0].0x0 (000000004768a90b) 00010000:00010000:0.0:1776187965.974322:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187965.974342:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4393ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974352:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4393ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974359:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4393ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974373:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974380:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974387:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974462:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974470:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974476:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187965.974723:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].393, 64 off33408 00000040:00080000:0.0:1776187965.974737:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4658, 184 off819072 00010000:00010000:0.0:1776187965.974777:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974786:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974793:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974799:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974805:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974814:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974837:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187965.974849:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000813fe89a reply state 00000000a484b864 transno 4294974936 ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974904:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4393ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.974909:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187965.974911:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4393ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.974914:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974923:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4393ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974929:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187965.974933:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4393ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.974936:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000af78cd92 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187965.974940:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974942:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4393ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.974953:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974957:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:0.0:1776187965.974962:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187965.974965:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4393ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.974966:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26a:0x0].0x0 (000000004c664cf8) 00010000:00010000:2.0:1776187965.974972:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187965.974975:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.974976:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4393ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.974991:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439404 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187965.974996:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000813fe89a reply state 00000000a484b864 transno 4294974936 ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187965.975006:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.975008:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187965.975010:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187965.975066:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000813fe89a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+577:11304:x1862467653385600:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 855us (2516us total) trans 4294974936 rc 0/0 00000100:00100000:0.0:1776187965.975076:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15256 00010000:00010000:3.0:1776187965.980296:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980320:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980327:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980333:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089ca4280 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.980338:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980345:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980362:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23b:0x0].0x14be06ab (000000003dd9608e) 00010000:00010000:3.0:1776187965.980364:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.980369:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980375:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee4393da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23b:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980395:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980401:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980405:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980410:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059094af5 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.980412:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980416:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980423:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23e:0x0].0x0 (00000000a7c2e43a) 00010000:00010000:3.0:1776187965.980425:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.980427:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.980431:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4393e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x23e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.981360:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187965.981388:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187965.981486:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981499:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981506:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981512:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000095ae11d5 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.981514:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981520:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981532:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0xa3962d5b (00000000298f4138) 00010000:00010000:3.0:1776187965.981535:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.981537:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981542:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4393f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981558:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981564:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981569:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981578:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.981580:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981586:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981593:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26a:0x0].0x0 (000000004c664cf8) 00010000:00010000:3.0:1776187965.981595:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.981597:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.981602:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4393fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x26a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.983322:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653385728 00000100:00100000:0.0:1776187965.983400:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653385792 00000100:00100000:0.0:1776187965.983423:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4379 00000100:00100000:0.0:1776187965.983499:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027970f29 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+576:11304:x1862467653385728:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187965.983755:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027970f29 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+577:11304:x1862467653385728:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 256us (2400us total) trans 4294974937 rc 0/0 00000100:00100000:3.0:1776187965.986783:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187965.986851:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653385920 00000100:00100000:3.0:1776187965.986933:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15257 00000100:00100000:3.0:1776187965.986940:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006538300c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+578:11304:x1862467653385920:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187965.987089:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187965.987119:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000818059f9/0x92b1eb87ee42b340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x262:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c662a expref: 578 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987142:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025d52ee0/0x92b1eb87ee4269e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x262:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4b5e expref: 577 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987153:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e35efdb/0x92b1eb87ee426a29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x262:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4b7a expref: 576 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987165:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eacc4a9f/0x92b1eb87ee420106 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x262:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28a4 expref: 575 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987173:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x262:0x0].0x0 (00000000ebea4c65) 00010000:00010000:3.0:1776187965.987183:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187965.987225:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43940b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987243:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43940b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987253:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43940b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987267:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987274:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987281:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987383:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x262:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987390:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.987401:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x262:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187965.988542:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4380 00000100:00100000:2.0:1776187965.988553:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffdb5047 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+574:11303:x1862467653385792:12345-192.168.204.20@tcp:37:dbench.0 00000040:00080000:3.0:1776187965.989201:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].394, 64 off33472 00000040:00080000:3.0:1776187965.989617:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4660, 184 off819384 00010000:00010000:3.0:1776187965.990533:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x262:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.990554:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.990565:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.990573:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.990580:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.990585:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x262:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.990613:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187965.990632:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006538300c reply state 000000004d16697a transno 4294974938 ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x262:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.990996:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43940b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.991005:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43940b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.991012:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43940b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.991018:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009372d704 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.991021:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43940b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.991028:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43940b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.991040:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:3.0:1776187965.991042:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.991046:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43940b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.991051:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43940b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187965.991061:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006538300c reply state 000000004d16697a transno 4294974938 ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187965.991711:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006538300c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+576:11304:x1862467653385920:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 4768us (4933us total) trans 4294974938 rc 0/0 00000100:00100000:3.0:1776187965.991721:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15257 00010000:00010000:3.0:1776187965.994761:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.994782:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.994790:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995844:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e57fe368 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.995851:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995860:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995891:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0xbcf75103 (0000000004f0a071) 00010000:00010000:3.0:1776187965.995894:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187965.995899:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995905:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439412 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995926:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x262:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995933:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x262:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995938:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x262:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995949:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187965.995951:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x262:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995957:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x262:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995964:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x262:0x0].0x0 (0000000015f09a80) 00010000:00010000:3.0:1776187965.995966:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187965.995968:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x262:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187965.995974:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439419 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x262:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187965.996198:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4379 00010000:00010000:0.0:1776187965.996248:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187965.996254:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x262:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.996264:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b9973b27 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187965.996267:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x262:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.996275:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x262:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.996286:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x262:0x0].0x0 (0000000015f09a80) 00010000:00010000:0.0:1776187965.996288:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187965.996292:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x262:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.996298:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439420 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x262:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187965.996314:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.996316:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187965.996318:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.001094:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653386048 00000100:00100000:2.0:1776187966.001157:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4381 00000100:00100000:2.0:1776187966.001163:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7827538 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+573:11304:x1862467653386048:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.001470:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7827538 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+574:11304:x1862467653386048:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 305us (1137us total) trans 4294974939 rc 0/0 00000100:00100000:2.0:1776187966.001485:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4381 00000100:00100000:3.0:1776187966.014043:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187966.017032:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.017040:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43943c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.017052:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9325880 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.017055:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43943c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.017062:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43943c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.017078:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24d:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187966.017081:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.017084:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43943c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.017090:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43943c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.017115:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.017116:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.017117:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.017778:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653386304 00000100:00100000:0.0:1776187966.017862:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4382 00000100:00100000:0.0:1776187966.017869:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094ba7718 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+572:11303:x1862467653386304:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.018131:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094ba7718 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+573:11303:x1862467653386304:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 261us (569us total) trans 4294974941 rc 0/0 00000100:00100000:0.0:1776187966.018139:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4382 00000100:00100000:0.0:1776187966.024495:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187966.024823:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43942e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024838:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43942e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024845:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43942e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024851:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c48750ea already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.024856:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43942e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024869:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43942e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024921:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x1674e29a (00000000f056c6a6) 00010000:00010000:3.0:1776187966.024924:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.024928:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43942e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024935:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43942e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024955:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439435 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024961:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439435 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024967:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439435 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024971:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000787789d5 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.024973:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439435 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024978:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439435 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024986:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24d:0x0].0x0 (000000007616c5c6) 00010000:00010000:3.0:1776187966.024988:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.024991:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439435 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.024996:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439435 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.025757:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43944a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.025870:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x217:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.025899:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.025905:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.026304:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].394, 64 off33472 00000040:00080000:1.0:1776187966.026325:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4662, 176 off819744 00010000:00010000:1.0:1776187966.026386:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x217:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026395:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026403:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026410:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026415:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026421:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026796:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.026818:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000842e0790 reply state 0000000084063cc1 transno 4294974942 ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x217:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026868:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439443 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026900:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439443 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026906:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439443 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026912:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d26d87db already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.026915:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439443 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026922:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439443 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026933:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000fd67caeb) 00010000:00010000:1.0:1776187966.026936:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.026939:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439443 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.026945:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439443 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.026955:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000842e0790 reply state 0000000084063cc1 transno 4294974942 ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43944a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.027045:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000842e0790 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+569:11303:x1862467653386432:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1531us (2555us total) trans 4294974942 rc 0/0 00000100:00100000:1.0:1776187966.027054:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15259 00010000:00010000:0.0:1776187966.027988:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.027994:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.028005:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.028007:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.028015:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.028026:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x217:0x0].0x0 (00000000194664fe) 00010000:00010000:0.0:1776187966.028028:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.028031:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.028037:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439458 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x217:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.028101:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.028103:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.028105:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187966.036630:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.036719:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653386560 00000100:00100000:0.0:1776187966.036779:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4383 00000100:00100000:0.0:1776187966.036785:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea7ec4a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+569:11304:x1862467653386560:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.037047:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea7ec4a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+570:11304:x1862467653386560:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 260us (424us total) trans 4294974943 rc 0/0 00000100:00100000:0.0:1776187966.037054:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4383 00000100:00100000:1.0:1776187966.039009:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187966.039243:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43944a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.039260:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43944a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.039268:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43944a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.039275:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d719b35a already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.039279:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43944a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.039282:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653386688 00010000:00010000:3.0:1776187966.039286:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43944a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.039303:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x469e1765 (000000006c0357c0) 00010000:00010000:3.0:1776187966.039306:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.039310:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43944a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.039316:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43944a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0x469e1765 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.039341:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.039345:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4384 00010000:00010000:3.0:1776187966.039353:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.039358:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bead27ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+570:11303:x1862467653386688:12345-192.168.204.20@tcp:35:dbench.0 00010000:00010000:3.0:1776187966.039368:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.039382:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.039384:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.039390:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.039399:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x217:0x0].0x0 (00000000194664fe) 00010000:00010000:3.0:1776187966.039401:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.039404:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.039410:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439451 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x217:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.039603:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bead27ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+570:11303:x1862467653386688:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 247us (600us total) trans 4294974944 rc 0/0 00000100:00100000:2.0:1776187966.039612:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4384 00000100:00100000:1.0:1776187966.050857:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.050962:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.050971:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653386816 00000100:00100000:3.0:1776187966.051095:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653386944 00000100:00100000:3.0:1776187966.052918:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15260 00000100:00100000:3.0:1776187966.052930:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008adfc18b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+571:11303:x1862467653386816:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.052997:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.053025:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000086013986/0x92b1eb87ee436939 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x215:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9e46 expref: 571 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053051:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004600452a/0x92b1eb87ee42268a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x215:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3593 expref: 570 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053064:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008dc1f4df/0x92b1eb87ee4226f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x215:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c35b6 expref: 569 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053076:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089367e09/0x92b1eb87ee41e2ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x215:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c48 expref: 568 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053088:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x215:0x0].0x0 (000000001cf35a08) 00010000:00010000:3.0:1776187966.053097:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.053400:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43945f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053416:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43945f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053426:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43945f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053440:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053446:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053456:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053560:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x215:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053568:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.053574:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187966.054011:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].395, 64 off33536 00000040:00080000:3.0:1776187966.054034:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4663, 184 off819928 00010000:00010000:3.0:1776187966.054424:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x215:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054440:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054452:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054460:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054466:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054477:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054509:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187966.054532:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008adfc18b reply state 000000001497ea01 transno 4294974945 ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x215:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054563:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.054568:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054576:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000052d92773 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.054581:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054589:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054601:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x215:0x0].0x0 (00000000adef1ff2) 00010000:00010000:3.0:1776187966.054604:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.054607:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054613:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439474 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x215:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054626:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.054627:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.054629:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.054669:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43945f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054675:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43945f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054681:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43945f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054687:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.054690:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43945f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054695:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43945f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054702:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000fd67caeb) 00010000:00010000:3.0:1776187966.054705:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.054707:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43945f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.054712:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43945f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187966.054721:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008adfc18b reply state 000000001497ea01 transno 4294974945 ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.054811:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008adfc18b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+569:11303:x1862467653386816:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1880us (3961us total) trans 4294974945 rc 0/0 00000100:00100000:3.0:1776187966.054820:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15260 00000100:00100000:3.0:1776187966.054852:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15261 00000100:00100000:3.0:1776187966.054858:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d2c560 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+568:11304:x1862467653386944:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.055478:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.055502:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005a6e21e3/0x92b1eb87ee42b3b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x266:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c665b expref: 568 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055522:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000070b64ba7/0x92b1eb87ee426e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x266:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4cca expref: 567 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055537:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000598114d8/0x92b1eb87ee426e4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x266:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4ce6 expref: 566 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055549:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007c37c99a/0x92b1eb87ee42028e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x266:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2953 expref: 565 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055559:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x266:0x0].0x0 (00000000476178fa) 00010000:00010000:3.0:1776187966.055569:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.055596:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee43947b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055609:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee43947b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055617:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee43947b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055632:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055644:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055650:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055749:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x266:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055758:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.055764:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.066543:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].395, 64 off33536 00000040:00080000:2.0:1776187966.066738:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4664, 184 off820112 00010000:00010000:2.0:1776187966.066863:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x266:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.066913:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.066926:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.066935:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.066947:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.066953:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.066980:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.067000:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b9d2c560 reply state 00000000322758ff transno 4294974946 ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x266:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.067054:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee43947b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.067061:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee43947b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.067067:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee43947b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.067074:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000949deda1 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.067078:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee43947b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.067085:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee43947b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.067093:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.067098:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:3.0:1776187966.067100:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.067102:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.067107:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee43947b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.067118:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee43947b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.067122:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.067126:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.067132:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b9d2c560 reply state 00000000322758ff transno 4294974946 ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.067135:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.067146:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x266:0x0].0x0 (0000000037029ea1) 00010000:00010000:3.0:1776187966.067148:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.067151:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.067157:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439490 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x266:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.067168:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.067170:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.067171:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.067640:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d2c560 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+566:11304:x1862467653386944:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 12779us (16676us total) trans 4294974946 rc 0/0 00000100:00100000:2.0:1776187966.067651:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15261 00010000:00010000:0.0:1776187966.067807:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067816:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067821:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067838:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e57fe368 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.067841:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067847:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067858:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0xf4ed591 (0000000004f0a071) 00010000:00010000:0.0:1776187966.067861:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.067863:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067868:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439466 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0xf4ed591 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067908:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067914:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067919:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067924:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009372d704 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.067926:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067932:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067939:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x215:0x0].0x0 (00000000adef1ff2) 00010000:00010000:0.0:1776187966.067941:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.067943:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.067948:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee43946d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x215:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.069701:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.069869:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653387072 00000100:00100000:0.0:1776187966.070069:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4385 00000100:00100000:0.0:1776187966.070075:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061378dda pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+565:11303:x1862467653387072:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.070365:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061378dda pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+566:11303:x1862467653387072:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 289us (672us total) trans 4294974947 rc 0/0 00000100:00100000:0.0:1776187966.070373:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4385 00010000:00010000:3.0:1776187966.075531:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075551:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075558:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075565:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b9973b27 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.075570:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075578:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075594:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x3afecd66 (000000006f67d5a2) 00010000:00010000:3.0:1776187966.075597:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.075601:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075608:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439482 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075634:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075641:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075647:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075652:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000752cecf8 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.075654:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075659:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075667:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x266:0x0].0x0 (0000000037029ea1) 00010000:00010000:3.0:1776187966.075670:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.075672:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.075677:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439489 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x266:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.081413:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.081469:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653387200 00000100:00100000:1.0:1776187966.081510:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.081583:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4386 00000100:00100000:3.0:1776187966.081591:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653387328 00000100:00100000:0.0:1776187966.081593:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7827538 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+565:11304:x1862467653387200:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187966.081626:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15262 00000100:00100000:3.0:1776187966.081631:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094ba7718 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+566:11303:x1862467653387328:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.081662:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.081689:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee4380d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca5b6 expref: 566 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.081714:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000880434e1/0x92b1eb87ee436f8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca029 expref: 565 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.081726:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee4380f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca5c4 expref: 565 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.081738:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee436b5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9eee expref: 564 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.081749:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37a:0x0].0x0 (000000001c12b283) 00010000:00010000:3.0:1776187966.081758:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.081800:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439497 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.081819:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.081829:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.081844:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.081851:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.081857:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7827538 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+563:11304:x1862467653387200:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 262us (457us total) trans 4294974948 rc 0/0 00010000:00010000:3.0:1776187966.081865:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.081899:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4386 00010000:00010000:3.0:1776187966.082566:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.082577:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.082584:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.084561:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].396, 64 off33600 00000040:00080000:2.0:1776187966.084587:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4665, 184 off820296 00010000:00010000:2.0:1776187966.084670:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084688:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084698:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084706:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084711:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084717:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084802:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.084826:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000094ba7718 reply state 000000009da595dd transno 4294974949 ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084914:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439497 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084922:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439497 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084929:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084935:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.084948:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439497 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084956:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439497 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084969:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000fd67caeb) 00010000:00010000:2.0:1776187966.084972:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.084976:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439497 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.084981:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439497 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.084991:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000094ba7718 reply state 000000009da595dd transno 4294974949 ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.085081:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094ba7718 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+564:11303:x1862467653387328:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3447us (3570us total) trans 4294974949 rc 0/0 00000100:00100000:2.0:1776187966.085090:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15262 00010000:00010000:1.0:1776187966.087841:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187966.087851:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.087866:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187966.087869:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.087891:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.087908:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37a:0x0].0x0 (000000005aa30e07) 00010000:00010000:1.0:1776187966.087910:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187966.087914:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 1/0,0 mode: --/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.087926:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee4394ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.088250:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.088253:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.088254:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187966.089067:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.089150:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653387456 00000100:00100000:2.0:1776187966.089221:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15263 00000100:00100000:2.0:1776187966.089228:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e9a71b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+564:11304:x1862467653387456:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.089281:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.089304:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003872ec9a/0x92b1eb87ee42b22f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x259:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c65c1 expref: 564 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089341:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000047582d3f/0x92b1eb87ee4260ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x259:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c48b0 expref: 563 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089354:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000097bc1167/0x92b1eb87ee42612a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x259:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c48d3 expref: 562 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089366:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000039661e8e/0x92b1eb87ee41fd9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x259:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2738 expref: 561 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089374:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x259:0x0].0x0 (0000000033ad716a) 00010000:00010000:2.0:1776187966.089384:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.089418:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4394b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089440:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4394b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089449:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4394b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089463:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089469:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089475:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089575:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x259:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089583:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.089588:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.089977:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].396, 64 off33600 00000040:00080000:2.0:1776187966.089997:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4666, 184 off820480 00010000:00010000:2.0:1776187966.090054:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x259:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090064:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090071:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090078:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090085:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090090:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090109:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.090124:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005e9a71b5 reply state 000000005c369b89 transno 4294974950 ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x259:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090166:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4394b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090172:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4394b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090177:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4394b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090183:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfd2bd90 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.090186:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4394b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090197:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4394b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090217:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:2.0:1776187966.090220:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.090223:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4394b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.090229:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4394b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.090237:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005e9a71b5 reply state 000000005c369b89 transno 4294974950 ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.090308:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e9a71b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+562:11304:x1862467653387456:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1079us (1247us total) trans 4294974950 rc 0/0 00000100:00100000:2.0:1776187966.090316:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15263 00010000:00010000:3.0:1776187966.091795:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.091804:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.091818:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c8d05e already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.091821:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.091829:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.091844:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x259:0x0].0x0 (0000000079764c80) 00010000:00010000:3.0:1776187966.091847:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.091851:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.091856:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee4394c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x259:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092451:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.092455:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.092457:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.092562:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092576:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092582:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092588:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000052d92773 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.092591:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092597:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092608:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0xa36e7a4 (00000000d2ce93fe) 00010000:00010000:3.0:1776187966.092611:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.092613:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092619:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43949e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0xa36e7a4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092634:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092639:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092650:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092655:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000019adf367 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.092657:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092662:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092667:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37a:0x0].0x0 (000000005aa30e07) 00010000:00010000:3.0:1776187966.092669:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.092671:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.092675:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394a5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.093348:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.093499:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653387584 00000100:00100000:0.0:1776187966.093551:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4387 00000100:00100000:0.0:1776187966.093557:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+561:11303:x1862467653387584:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.093779:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+562:11303:x1862467653387584:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 221us (435us total) trans 4294974951 rc 0/0 00000100:00100000:0.0:1776187966.093787:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4387 00000100:00100000:0.0:1776187966.096936:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.097388:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653387712 00000100:00100000:2.0:1776187966.097446:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4388 00000100:00100000:2.0:1776187966.097453:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef5c0c7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+562:11304:x1862467653387712:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.097818:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef5c0c7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+563:11304:x1862467653387712:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 363us (889us total) trans 4294974952 rc 0/0 00000100:00100000:2.0:1776187966.097826:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4388 00010000:00010000:3.0:1776187966.098699:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098713:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098720:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098728:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006b72ffb6 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.098731:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098739:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098755:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x6324417e (0000000090869b29) 00010000:00010000:3.0:1776187966.098758:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.098761:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098768:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4394ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098784:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098790:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098795:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098800:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025e5acf1 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.098802:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098807:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098814:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x259:0x0].0x0 (0000000079764c80) 00010000:00010000:3.0:1776187966.098817:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.098819:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.098825:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4394c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x259:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.104850:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.104980:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653387840 00000100:00100000:0.0:1776187966.105030:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15264 00000100:00100000:0.0:1776187966.105036:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ceb0237 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+562:11304:x1862467653387840:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.105093:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187966.105123:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cb3a64a7/0x92b1eb87ee42a540 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x246:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c60d5 expref: 562 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105161:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fddc4cb4/0x92b1eb87ee424e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x246:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4274 expref: 561 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105175:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ceb230a8/0x92b1eb87ee424ea0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x246:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c42ac expref: 560 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105187:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000db49bd43/0x92b1eb87ee41f601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x246:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c23f7 expref: 559 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105196:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x246:0x0].0x0 (00000000a54a6329) 00010000:00010000:0.0:1776187966.105215:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.105247:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4394cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105262:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4394cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105271:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4394cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105286:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105293:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105299:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105397:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x246:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105405:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105419:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187966.105752:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].397, 64 off33664 00000040:00080000:0.0:1776187966.105773:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4667, 184 off820664 00010000:00010000:0.0:1776187966.105834:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x246:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105843:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105850:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105856:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105862:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105868:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.105947:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.105964:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000ceb0237 reply state 00000000c880b089 transno 4294974953 ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x246:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.106006:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4394cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.106012:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4394cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.106018:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4394cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.106023:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.106027:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4394cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.106034:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4394cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.106043:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:0.0:1776187966.106046:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.106049:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4394cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.106054:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4394cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.106063:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000ceb0237 reply state 00000000c880b089 transno 4294974953 ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.106069:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.106076:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.106085:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005f47f5e7 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.106088:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.106094:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.106114:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x246:0x0].0x0 (000000000f4996f9) 00010000:00010000:3.0:1776187966.106118:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.106120:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.106125:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4394e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x246:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.106138:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.106139:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.106141:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.106146:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ceb0237 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+560:11304:x1862467653387840:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1107us (1301us total) trans 4294974953 rc 0/0 00000100:00100000:0.0:1776187966.106155:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15264 00010000:00010000:0.0:1776187966.110391:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110412:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110419:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110425:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.110430:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110437:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110453:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0xcd7d97c8 (000000007f00126a) 00010000:00010000:0.0:1776187966.110456:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.110461:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110466:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110485:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110491:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110496:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110501:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007072c805 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.110503:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110508:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110515:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x246:0x0].0x0 (000000000f4996f9) 00010000:00010000:0.0:1776187966.110517:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.110519:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.110524:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x246:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.112599:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.112693:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653387968 00000100:00100000:0.0:1776187966.112748:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4389 00000100:00100000:0.0:1776187966.112754:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000449a5d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+559:11304:x1862467653387968:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.113035:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000449a5d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+560:11304:x1862467653387968:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 280us (444us total) trans 4294974954 rc 0/0 00000100:00100000:0.0:1776187966.113044:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4389 00000100:00100000:1.0:1776187966.119540:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.119587:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.120889:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653388096 00000100:00100000:0.0:1776187966.120961:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653388224 00000100:00100000:0.0:1776187966.120978:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15265 00000100:00100000:0.0:1776187966.120985:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003469a13f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+561:11304:x1862467653388096:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.121035:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187966.121064:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000c8c3114/0x92b1eb87ee42b3f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c6677 expref: 561 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121090:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000196d25bf/0x92b1eb87ee4262b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4951 expref: 560 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121104:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003e3d232f/0x92b1eb87ee4262f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c496d expref: 559 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121120:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000050ecd85b/0x92b1eb87ee41fe82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c279a expref: 558 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.121124:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15266 00000100:00100000:3.0:1776187966.121132:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071bce4b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+557:11303:x1862467653388224:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.121148:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25b:0x0].0x0 (00000000dd313b1e) 00010000:00010000:0.0:1776187966.121159:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.121161:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.121176:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000637904cb/0x92b1eb87ee436327 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x213:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9c6a expref: 557 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121191:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121196:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c1a7a905/0x92b1eb87ee422517 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x213:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3523 expref: 556 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121224:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121231:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b5925b87/0x92b1eb87ee42255d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x213:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c353f expref: 555 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121240:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121247:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000040a9f3be/0x92b1eb87ee41e1e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x213:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bf4 expref: 554 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121257:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x213:0x0].0x0 (0000000047896668) 00010000:00010000:0.0:1776187966.121258:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121264:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.121267:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121276:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121279:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121291:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121299:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121313:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121320:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121331:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121379:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121388:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121394:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187966.121752:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].397, 64 off33664 00000040:00080000:0.0:1776187966.121775:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4668, 184 off820848 00010000:00010000:3.0:1776187966.121795:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x213:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121806:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.121813:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121841:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121854:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121861:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121869:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121898:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121905:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121919:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.121936:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000003469a13f reply state 00000000988d5af7 transno 4294974955 ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121983:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121990:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.121996:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.122002:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007072c805 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.122005:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.122012:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.122020:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:0.0:1776187966.122023:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.122026:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.122031:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4394eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x244:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.122041:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000003469a13f reply state 00000000988d5af7 transno 4294974955 ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.122123:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003469a13f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+555:11304:x1862467653388096:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1137us (2592us total) trans 4294974955 rc 0/0 00000100:00100000:0.0:1776187966.122130:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15265 00010000:00010000:2.0:1776187966.122530:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.122536:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.122550:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b23405f4 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.122553:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.122559:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.122570:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25b:0x0].0x0 (000000007f00126a) 00010000:00010000:2.0:1776187966.122573:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.122575:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.122581:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439515 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.122592:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.122594:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.122595:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1776187966.123697:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].398, 64 off33728 00000040:00080000:2.0:1776187966.123725:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4669, 176 off821024 00010000:00010000:2.0:1776187966.123804:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x213:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123820:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123830:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123843:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123849:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123855:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123891:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.123909:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000071bce4b9 reply state 00000000905d2427 transno 4294974956 ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x213:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123961:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123968:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123973:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123978:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000019adf367 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.123982:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.123988:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.124004:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000fd67caeb) 00010000:00010000:2.0:1776187966.124006:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.124009:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.124015:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee4394f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.124024:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000071bce4b9 reply state 00000000905d2427 transno 4294974956 ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.124163:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071bce4b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+556:11303:x1862467653388224:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3028us (4574us total) trans 4294974956 rc 0/0 00000100:00100000:2.0:1776187966.124172:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15266 00010000:00010000:2.0:1776187966.127426:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.127436:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.127452:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfd2bd90 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.127455:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.127465:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.127483:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x213:0x0].0x0 (00000000d2ce93fe) 00010000:00010000:2.0:1776187966.127486:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.127491:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.127496:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43951c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x213:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.127513:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.127514:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.127516:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.131049:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187966.131961:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.131983:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.131992:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.131999:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.132005:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.132013:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.132032:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x76821429 (000000000f4996f9) 00010000:00010000:3.0:1776187966.132036:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.132041:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.132047:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4394f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x244:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.132070:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.132076:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.132082:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.132087:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.132088:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.132093:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.132100:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25b:0x0].0x0 (000000007f00126a) 00000100:00100000:0.0:1776187966.132518:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.132569:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653388288 00000100:00100000:0.0:1776187966.132616:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4390 00000100:00100000:0.0:1776187966.132623:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef5c0c7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+556:11304:x1862467653388288:12345-192.168.204.20@tcp:37:dbench.0 00010000:00010000:3.0:1776187966.134387:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.134397:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.134409:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439507 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x25b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.135898:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653388352 00000100:00100000:3.0:1776187966.135962:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15267 00000100:00100000:3.0:1776187966.135969:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d1abae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+557:2224:x1862467653388352:12345-192.168.204.20@tcp:101:ll_sa_11304.0 00010000:00010000:3.0:1776187966.135989:0:5517:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187966.136010:0:5517:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439523 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa86 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136065:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43952a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136080:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43952a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136090:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43952a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136116:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee439531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136123:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee439531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136129:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee439531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136226:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136237:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136244:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187966.136346:0:5517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x26e:0x0]: returning size 11776 00000004:00200000:3.0:1776187966.136350:0:5517:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187966.136378:0:5517:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136401:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43952a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136408:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43952a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136414:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43952a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136419:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007a73b3e2 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.136422:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43952a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136428:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43952a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136439:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:3.0:1776187966.136442:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.136444:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43952a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136450:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43952a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136460:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee439531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136465:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee439531 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136470:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee439531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136475:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000547596a2 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.136477:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee439531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136483:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee439531 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136489:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x106120ec (0000000037029ea1) 00010000:00010000:3.0:1776187966.136492:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.136493:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee439531 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136499:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee439531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136527:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439523 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa86 expref: 559 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136539:0:5517:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa86 expref: 558 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.136552:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26e:0x0].0x0 (0000000062f492a7) 00010000:00010000:3.0:1776187966.136554:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1776187966.136556:0:5517:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000072a961c9, rc 0) 00000100:00100000:3.0:1776187966.136606:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d1abae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+558:2224:x1862467653388352:12345-192.168.204.20@tcp:101:ll_sa_11304.0 Request processed in 636us (4091us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.136614:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15267 00010000:00010000:3.0:1776187966.137441:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137453:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137459:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137464:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000052d92773 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.137466:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137472:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137484:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0xe5dc7a0b (000000005aa30e07) 00010000:00010000:3.0:1776187966.137486:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.137488:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137493:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439500 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0xe5dc7a0b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137508:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137513:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137517:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137523:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000752cecf8 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.137525:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137529:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137536:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x213:0x0].0x0 (00000000d2ce93fe) 00010000:00010000:3.0:1776187966.137538:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.137540:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.137545:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43950e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x213:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.138327:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.140861:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653388480 00000100:00100000:1.0:1776187966.140958:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15268 00000100:00100000:1.0:1776187966.140965:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057ad4e34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+557:11303:x1862467653388480:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.141028:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1776187966.141055:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4381a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x386:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca603 expref: 557 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.141079:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee437e86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x386:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca4f9 expref: 556 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.141089:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x386:0x0].0x0 (00000000693f1349) 00010000:00010000:1.0:1776187966.141099:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.141389:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43953f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.141406:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43953f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.141421:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43953f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.141433:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.141439:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.141444:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.141546:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x386:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.141553:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x386:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.141559:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x386:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.143339:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].398, 64 off33728 00000040:00080000:1.0:1776187966.143794:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4670, 184 off821208 00010000:00010000:1.0:1776187966.144659:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x386:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145065:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x386:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145080:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x386:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145090:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x386:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145096:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x386:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145203:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x386:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145237:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.145263:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000057ad4e34 reply state 0000000059a35130 transno 4294974957 ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x386:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145324:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43953f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145330:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43953f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145335:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43953f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145340:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d26d87db already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.145343:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43953f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.145442:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.145448:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x386:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.145455:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4841773 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.145458:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x386:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.145464:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x386:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.145477:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x386:0x0].0x0 (000000003d48dd25) 00010000:00010000:3.0:1776187966.145480:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.145484:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x386:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.145489:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439554 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x386:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.145501:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.145503:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.145504:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.145535:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43953f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145549:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000fd67caeb) 00010000:00010000:1.0:1776187966.145552:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.145553:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43953f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.145559:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43953f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.145571:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000057ad4e34 reply state 0000000059a35130 transno 4294974957 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.146611:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057ad4e34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+557:11303:x1862467653388480:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 4709us (7353us total) trans 4294974957 rc 0/0 00000100:00100000:1.0:1776187966.146624:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15268 00010000:00010000:1.0:1776187966.150406:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150427:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150435:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150441:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.150446:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150453:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150470:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0xe7aaf970 (00000000889219c6) 00010000:00010000:1.0:1776187966.150473:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.150478:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150485:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439546 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0xe7aaf970 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150508:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x386:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150514:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x386:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150521:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x386:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150526:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006aa2e88c already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.150528:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x386:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150534:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x386:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150540:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x386:0x0].0x0 (000000003d48dd25) 00010000:00010000:1.0:1776187966.150543:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.150544:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x386:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.150554:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43954d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x386:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.151936:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.152452:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653388608 00000100:00100000:1.0:1776187966.152508:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4391 00000100:00100000:1.0:1776187966.152513:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098b0ffb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+556:11303:x1862467653388608:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.152758:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098b0ffb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+557:11303:x1862467653388608:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 242us (829us total) trans 4294974958 rc 0/0 00000100:00100000:1.0:1776187966.152765:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4391 00000100:00100000:0.0:1776187966.154738:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef5c0c7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+555:11304:x1862467653388288:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 22108us (23695us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.154753:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4390 00000100:00100000:2.0:1776187966.156922:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.157076:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653388736 00000100:00100000:1.0:1776187966.157132:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15269 00000100:00100000:1.0:1776187966.157139:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007baa2a36 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+555:11303:x1862467653388736:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.157189:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.157230:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000038e5637b/0x92b1eb87ee437b5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca3fd expref: 555 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157255:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a82bf270/0x92b1eb87ee422b84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3737 expref: 554 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157268:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009f1ffb0f/0x92b1eb87ee422bd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3761 expref: 553 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157279:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009e79a70a/0x92b1eb87ee41e457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1cf7 expref: 552 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157287:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21a:0x0].0x0 (00000000b74722e3) 00010000:00010000:1.0:1776187966.157296:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.157327:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43955b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157343:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43955b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157352:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43955b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157368:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157374:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157380:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157487:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157496:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.157503:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.157854:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].399, 64 off33792 00000040:00080000:1.0:1776187966.158306:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4671, 184 off821392 00010000:00010000:1.0:1776187966.158392:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158414:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158423:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158431:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158437:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158444:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158467:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.158485:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007baa2a36 reply state 000000002d194baf transno 4294974959 ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158535:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43955b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158542:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43955b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158548:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43955b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158553:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.158556:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43955b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158563:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43955b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158572:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000fd67caeb) 00010000:00010000:1.0:1776187966.158575:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.158578:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43955b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.158582:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43955b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.158591:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007baa2a36 reply state 000000002d194baf transno 4294974959 ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.158679:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007baa2a36 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+553:11303:x1862467653388736:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1538us (1762us total) trans 4294974959 rc 0/0 00000100:00100000:1.0:1776187966.158688:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15269 00010000:00010000:2.0:1776187966.158861:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.158866:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.158907:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d719b35a already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.158910:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.158916:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.158925:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21a:0x0].0x0 (000000001c12b283) 00010000:00010000:2.0:1776187966.158927:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.158929:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.158934:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439570 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.158949:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.158950:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.158952:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.161966:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.161987:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.161994:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162000:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cea3a6c8 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.162003:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162013:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162034:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0xc3d50206 (0000000077c38ae7) 00010000:00010000:0.0:1776187966.162037:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.162041:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162046:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439562 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0xc3d50206 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162067:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162073:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162077:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162081:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.162083:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162088:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162094:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21a:0x0].0x0 (000000001c12b283) 00010000:00010000:0.0:1776187966.162096:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.162098:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.162423:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439569 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.165634:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.165718:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653388864 00000100:00100000:0.0:1776187966.165776:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4392 00000100:00100000:0.0:1776187966.165783:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca377c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+552:11303:x1862467653388864:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.166646:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca377c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+553:11303:x1862467653388864:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 859us (1017us total) trans 4294974960 rc 0/0 00000100:00100000:0.0:1776187966.166656:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4392 00000100:00100000:3.0:1776187966.177851:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.177920:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653388992 00000100:00100000:1.0:1776187966.177981:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15270 00000100:00100000:1.0:1776187966.177988:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a3f804d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+553:11303:x1862467653388992:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.178048:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.178077:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006ed98c45/0x92b1eb87ee435ca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x212:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9b05 expref: 553 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178099:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7b75c6d/0x92b1eb87ee422445 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x212:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c34dd expref: 552 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178116:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c11042f6/0x92b1eb87ee422468 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x212:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c34eb expref: 551 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178130:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000042029962/0x92b1eb87ee41e10f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x212:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b99 expref: 550 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178138:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x212:0x0].0x0 (00000000738b2c77) 00010000:00010000:1.0:1776187966.178147:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.178178:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439577 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178193:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439577 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178202:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439577 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178226:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178233:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178239:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178332:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x212:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178346:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.178360:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.179802:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.179924:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653389120 00000100:00100000:0.0:1776187966.179971:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4393 00000100:00100000:0.0:1776187966.179977:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000183af6c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+550:11304:x1862467653389120:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.180218:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000183af6c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+551:11304:x1862467653389120:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 239us (422us total) trans 4294974961 rc 0/0 00000100:00100000:0.0:1776187966.180227:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4393 00000040:00080000:2.0:1776187966.181016:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].400, 64 off33856 00000040:00080000:2.0:1776187966.181047:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4672, 184 off821576 00010000:00010000:2.0:1776187966.181122:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x212:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181144:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181155:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181163:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181169:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181176:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181201:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.181228:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008a3f804d reply state 000000001e787a2e transno 4294974962 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x212:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.181269:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187966.181276:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439577 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181282:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439577 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181288:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439577 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181294:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.181298:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439577 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181304:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439577 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181317:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000fd67caeb) 00010000:00010000:2.0:1776187966.181320:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.181324:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439577 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.181327:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.181330:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439577 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.181331:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.181338:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfd2bd90 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.181340:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.181342:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008a3f804d reply state 000000001e787a2e transno 4294974962 ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.181347:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.181359:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x212:0x0].0x0 (00000000889219c6) 00010000:00010000:3.0:1776187966.181361:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.181363:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.181367:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43958c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x212:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.181376:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.181377:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.181378:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.181418:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a3f804d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+552:11303:x1862467653388992:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3428us (3572us total) trans 4294974962 rc 0/0 00000100:00100000:2.0:1776187966.181426:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15270 00000100:00100000:2.0:1776187966.181456:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653389184 00000100:00100000:2.0:1776187966.181490:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15271 00000100:00100000:2.0:1776187966.181495:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000013c3909d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+552:11380:x1862467653389184:12345-192.168.204.20@tcp:101:ll_sa_11304.0 00010000:00010000:2.0:1776187966.181509:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187966.181521:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439593 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa8d expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181546:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa8d expref: 553 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181555:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa8d expref: 553 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.181562:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:2.0:1776187966.181564:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.181566:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000089fb6120, rc 0) 00000100:00100000:2.0:1776187966.181598:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000013c3909d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+553:11380:x1862467653389184:12345-192.168.204.20@tcp:101:ll_sa_11304.0 Request processed in 103us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.181605:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15271 00000100:00100000:0.0:1776187966.189336:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.189383:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.189702:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653389312 00000100:00100000:3.0:1776187966.189774:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15272 00000100:00100000:3.0:1776187966.189781:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d86a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+553:11304:x1862467653389312:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.189835:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1776187966.189866:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f9da0182/0x92b1eb87ee431284 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c85a3 expref: 553 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.189913:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000076ab862d/0x92b1eb87ee4238ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3b82 expref: 552 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.189925:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee423961 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3bba expref: 551 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.189936:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d8a786aa/0x92b1eb87ee41ec3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22d:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2038 expref: 550 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.189952:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22d:0x0].0x0 (00000000c9741f8b) 00010000:00010000:3.0:1776187966.189966:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee438ed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa2b expref: 549 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.189974:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:3.0:1776187966.189977:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.190006:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.190019:0:5517:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439593 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa8d expref: 548 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.190027:0:5517:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.190060:0:5517:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa8d expref: 548 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.190071:0:5517:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa8d expref: 548 pid: 12471 timeout: 543 lvb_type: 0 00000100:00100000:3.0:1776187966.190084:0:5517:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f1d31b1 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5517:1862467659896448:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187966.190149:0:5517:0:(client.c:2500:ptlrpc_set_wait()) set 000000003383344d going to sleep for 43 seconds 00010000:00010000:1.0:1776187966.191968:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.191986:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.191994:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192000:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006aa2e88c already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.192004:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192010:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192024:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x6428115e (000000003d48dd25) 00010000:00010000:1.0:1776187966.192027:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.192031:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192036:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43957e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20f:0x0].0x6428115e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192058:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192064:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192074:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192079:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.192081:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192087:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192265:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x212:0x0].0x0 (00000000889219c6) 00010000:00010000:1.0:1776187966.192268:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.192270:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.192275:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439585 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x212:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.192382:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653389376 00000100:00100000:2.0:1776187966.192445:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4394 00000100:00100000:2.0:1776187966.192451:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce70d696 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+548:11380:x1862467653389376:12345-192.168.204.20@tcp:37:ll_sa_11304.0 00000100:00100000:0.0:1776187966.193182:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.193372:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653389440 00000100:00100000:3.0:1776187966.193419:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4395 00000100:00100000:3.0:1776187966.193424:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1f10cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+550:11303:x1862467653389440:12345-192.168.204.20@tcp:37:dbench.0 00000100:00100000:1.0:1776187966.199049:0:5517:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f1d31b1 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5517:1862467659896448:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187966.199086:0:5517:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.200974:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce70d696 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+550:11380:x1862467653389376:12345-192.168.204.20@tcp:37:ll_sa_11304.0 Request processed in 8514us (11583us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.200989:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4394 00000100:00100000:2.0:1776187966.202746:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1f10cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+548:11303:x1862467653389440:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 9314us (9559us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.203522:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4395 00000100:00100000:3.0:1776187966.205950:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.206046:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653389504 00000100:00100000:0.0:1776187966.206099:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15273 00000100:00100000:0.0:1776187966.206105:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044f45045 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+548:11303:x1862467653389504:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:0.0:1776187966.206126:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187966.206147:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4395a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa94 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206217:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4395a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206233:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4395a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206243:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4395a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206257:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4395af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206263:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4395af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206268:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4395af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206494:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee4395b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206504:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee4395b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206510:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee4395b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1776187966.206543:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20b:0x0]: returning size 260096 00000004:00200000:0.0:1776187966.206547:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187966.206563:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee4395b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206574:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee4395b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206583:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4395a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206589:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4395a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206594:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4395a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206600:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d042148c already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.206603:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4395a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206610:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4395a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206622:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x0 (00000000c45808c0) 00010000:00010000:0.0:1776187966.206625:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.206629:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4395a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206635:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee4395a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206646:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4395af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206652:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4395af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206658:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4395af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206663:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.206665:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4395af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.206670:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4395af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.207501:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0xf786fdb3 (00000000219adb48) 00010000:00010000:0.0:1776187966.207505:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.207508:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4395af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.207515:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4395af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.207555:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4395a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa94 expref: 550 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.207566:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee4395b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa94 expref: 549 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.207572:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20b:0x0].0x0 (00000000c639aa5e) 00010000:00010000:0.0:1776187966.207575:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1776187966.207577:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c08abd94, rc 0) 00000100:00100000:0.0:1776187966.207650:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044f45045 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+549:11303:x1862467653389504:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 1544us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.207660:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15273 00000100:00100000:0.0:1776187966.221285:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.221333:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.221367:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.221456:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653389696 00000100:00100000:3.0:1776187966.221518:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4396 00000100:00100000:3.0:1776187966.221525:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4912074 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+549:11303:x1862467653389696:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187966.221863:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4912074 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+550:11303:x1862467653389696:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 337us (530us total) trans 4294974963 rc 0/0 00000100:00100000:3.0:1776187966.221871:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4396 00000100:00100000:2.0:1776187966.222106:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653389568 00000100:00100000:2.0:1776187966.222140:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15274 00000100:00100000:2.0:1776187966.222146:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000870140c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+550:2224:x1862467653389568:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:2.0:1776187966.222156:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187966.222177:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4395bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caa9b expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222238:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4395c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222255:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4395c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222266:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4395c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222280:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4395cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222287:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4395cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222293:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4395cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222383:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4395d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222397:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4395d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222404:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4395d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187966.222428:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20d:0x0]: returning size 260096 00000004:00200000:2.0:1776187966.222431:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187966.222448:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4395d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222457:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4395d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222465:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4395c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222471:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4395c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222477:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4395c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222482:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d81ab485 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.222486:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4395c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222492:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4395c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222507:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x0 (00000000c45808c0) 00010000:00010000:2.0:1776187966.222509:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.222513:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4395c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222519:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4395c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222530:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4395cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222536:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4395cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222540:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4395cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222545:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092776876 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.222547:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4395cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222552:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4395cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222558:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x204a7f30 (0000000079764c80) 00010000:00010000:2.0:1776187966.222560:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.222562:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4395cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222571:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4395cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222597:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4395bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa9b expref: 552 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222607:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4395d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa9b expref: 551 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.222613:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20d:0x0].0x0 (000000004c042b89) 00010000:00010000:2.0:1776187966.222615:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1776187966.222617:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000597b6781, rc 0) 00000100:00100000:1.0:1776187966.222734:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653389760 00010000:00010000:1.0:1776187966.222755:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa8d expref: 552 pid: 12471 timeout: 543 lvb_type: 0 00000100:00100000:1.0:1776187966.222780:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4311 00000100:00100000:1.0:1776187966.222785:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000776008e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+552:2222:x1862467653389760:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1776187966.222796:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187966.222801:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439593 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa8d expref: 552 pid: 12471 timeout: 543 lvb_type: 0 00010000:00010000:1.0:1776187966.222810:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439593 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa8d expref: 552 pid: 12471 timeout: 543 lvb_type: 0 00010000:00010000:1.0:1776187966.222823:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439593 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa8d expref: 552 pid: 12471 timeout: 543 lvb_type: 0 00010000:00010000:1.0:1776187966.222833:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:1.0:1776187966.222836:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.222845:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.222850:0:7121:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.222902:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187966.222959:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000870140c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+551:2224:x1862467653389568:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 812us (1682us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.222966:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15274 00000100:00100000:1.0:1776187966.223567:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000776008e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+550:2222:x1862467653389760:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 778us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187966.223578:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4311 00010000:00010000:1.0:1776187966.223635:0:5517:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.223645:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.223667:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.223687:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.223695:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.223822:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.223830:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.223836:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.224426:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].399, 64 off33792 00000004:00080000:1.0:1776187966.224434:0:5517:0:(osp_sync.c:1658:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443208558755ns, next at 444208555939ns, rc = 0 00000040:00080000:1.0:1776187966.224454:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4673, 184 off821760 00010000:00010000:1.0:1776187966.224520:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.224531:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.224539:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.224545:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.224551:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.224557:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.224776:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.224803:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d86a1680 reply state 000000003f11c719 transno 4294974964 ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.224850:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.224857:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.224862:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.224867:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000752cecf8 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.224870:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.225088:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.225099:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:1.0:1776187966.225102:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.225105:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.225111:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43959a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.225120:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d86a1680 reply state 000000003f11c719 transno 4294974964 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.225189:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d86a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+551:11304:x1862467653389312:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 35406us (35860us total) trans 4294974964 rc 0/0 00000100:00100000:1.0:1776187966.225197:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15272 00010000:00010000:3.0:1776187966.226256:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.226262:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.226273:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d26d87db already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.226276:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.226283:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.226295:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22d:0x0].0x0 (000000003d48dd25) 00010000:00010000:3.0:1776187966.226297:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.226299:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.226305:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee4395e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.226317:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.226319:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.226321:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187966.237291:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.237443:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653389888 00000100:00100000:1.0:1776187966.237535:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15275 00000100:00100000:1.0:1776187966.237543:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035ef4933 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+551:11303:x1862467653389888:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.237598:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1776187966.237625:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee4395b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa94 expref: 551 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237659:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce65d641/0x92b1eb87ee422174 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c33fd expref: 550 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237676:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d38cf38e/0x92b1eb87ee422197 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c340b expref: 549 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237686:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003330fb98/0x92b1eb87ee41de4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a96 expref: 548 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237694:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20b:0x0].0x0 (00000000c639aa5e) 00010000:00010000:1.0:1776187966.237706:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee438f81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa4e expref: 547 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237712:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x0 (00000000c45808c0) 00010000:00010000:1.0:1776187966.237715:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.237742:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4395ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237754:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4395ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237763:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4395ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237775:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237780:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237784:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237930:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237938:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.237952:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.238334:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].400, 64 off33856 00000040:00080000:1.0:1776187966.238356:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4674, 184 off821944 00010000:00010000:1.0:1776187966.238415:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238425:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238432:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238438:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238444:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238449:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238469:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.238487:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000035ef4933 reply state 00000000ade155f9 transno 4294974965 ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238532:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4395ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238538:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4395ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238543:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4395ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238548:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.238551:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4395ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238557:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4395ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238565:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x0 (00000000c45808c0) 00010000:00010000:1.0:1776187966.238567:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.238570:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4395ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.238575:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4395ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.238583:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000035ef4933 reply state 00000000ade155f9 transno 4294974965 ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.238665:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035ef4933 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+548:11303:x1862467653389888:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1117us (1379us total) trans 4294974965 rc 0/0 00000100:00100000:1.0:1776187966.238674:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15275 00010000:00010000:0.0:1776187966.239268:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.239275:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.239285:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c48750ea already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.239288:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.239294:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.239303:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20b:0x0].0x0 (000000006c0357c0) 00010000:00010000:0.0:1776187966.239305:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.239307:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.239312:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439603 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.239323:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.239324:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.239325:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.242793:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187966.243922:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.243937:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.243944:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.243951:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.243955:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.243963:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244020:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244031:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244038:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244045:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.244048:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244054:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244074:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0xf786fdb3 (00000000194664fe) 00010000:00010000:1.0:1776187966.244077:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.244081:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244088:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4395f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20a:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244110:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244116:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244122:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244127:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000787789d5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.244129:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244134:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244143:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20b:0x0].0x0 (000000006c0357c0) 00010000:00010000:1.0:1776187966.244146:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.244148:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.244154:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4395fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.244188:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x10cfb8f0 (00000000889219c6) 00010000:00010000:3.0:1776187966.244191:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.244194:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.244199:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee4395d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0x10cfb8f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.244222:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.244228:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.244234:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.244240:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006aa2e88c already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.244242:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.244248:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.244256:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22d:0x0].0x0 (000000003d48dd25) 00010000:00010000:3.0:1776187966.244258:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.244260:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.244265:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4395e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.244309:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653390016 00000100:00100000:2.0:1776187966.244370:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4397 00000100:00100000:2.0:1776187966.244379:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d89ed77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+546:11304:x1862467653390016:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.244690:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d89ed77 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+547:11304:x1862467653390016:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 310us (1904us total) trans 4294974966 rc 0/0 00000100:00100000:2.0:1776187966.244699:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4397 00000100:00100000:0.0:1776187966.244813:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.245003:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653390144 00000100:00100000:2.0:1776187966.245040:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4398 00000100:00100000:2.0:1776187966.245045:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b518a13a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+547:11303:x1862467653390144:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.245150:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b518a13a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+548:11303:x1862467653390144:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 105us (338us total) trans 4294974967 rc 0/0 00000100:00100000:2.0:1776187966.245157:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4398 00000100:00100000:0.0:1776187966.248353:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.248389:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.248497:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653390272 00000100:00100000:1.0:1776187966.248546:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653390400 00000100:00100000:1.0:1776187966.248574:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15276 00000100:00100000:1.0:1776187966.248580:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a36f99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+549:11304:x1862467653390272:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.248638:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.248666:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d156e32e/0x92b1eb87ee431ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c8819 expref: 549 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.248702:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a7562719/0x92b1eb87ee422d05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c37b5 expref: 548 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.248715:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000021953e79/0x92b1eb87ee422d2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c37c3 expref: 547 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.248727:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000410a3076/0x92b1eb87ee41e61e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d9f expref: 546 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.248732:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15277 00000100:00100000:2.0:1776187966.248737:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043c5c2b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+545:11303:x1862467653390400:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.248738:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21e:0x0].0x0 (00000000cc1a1cf1) 00010000:00010000:1.0:1776187966.248747:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.248759:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.248773:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee4395d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa9b expref: 545 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.248779:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43960a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248786:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000059e7efd/0x92b1eb87ee42221c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3435 expref: 544 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.248794:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43960a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248795:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004f3e0d18/0x92b1eb87ee42223f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3443 expref: 543 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.248804:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43960a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248808:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000007551409/0x92b1eb87ee41df48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20d:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1af8 expref: 542 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248815:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20d:0x0].0x0 (000000004c042b89) 00010000:00010000:1.0:1776187966.248817:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248822:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.248823:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.248828:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248833:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439618 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248842:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439618 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248847:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439618 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248856:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248862:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248867:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248964:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.248969:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248972:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.248976:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.248979:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.248981:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.249931:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].401, 64 off33920 00000040:00080000:1.0:1776187966.249932:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].401, 64 off33920 00000040:00080000:2.0:1776187966.249951:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4675, 184 off822128 00000040:00080000:1.0:1776187966.249958:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4676, 184 off822312 00010000:00010000:2.0:1776187966.250010:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250010:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.250023:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250023:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.250032:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250032:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.250040:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250040:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250046:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.250052:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250052:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.250057:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250192:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00010000:1.0:1776187966.250220:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b2a36f99 reply state 000000005c161b7a transno 4294974969 ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250270:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43960a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250276:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43960a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250282:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43960a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250288:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9325880 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.250292:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43960a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250299:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43960a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250310:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:1.0:1776187966.250312:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.250316:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43960a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.250323:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43960a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.250331:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b2a36f99 reply state 000000005c161b7a transno 4294974969 ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.250423:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a36f99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+544:11304:x1862467653390272:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1841us (2077us total) trans 4294974969 rc 0/0 00000100:00100000:1.0:1776187966.250432:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15276 00010000:00010000:2.0:1776187966.252145:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00010000:2.0:1776187966.252176:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000043c5c2b2 reply state 000000001a07294c transno 4294974968 ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.252251:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439618 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.252259:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439618 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.252266:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439618 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.252272:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aea18492 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.252275:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439618 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.252282:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439618 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.252296:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x0 (00000000c45808c0) 00010000:00010000:2.0:1776187966.252299:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.252303:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439618 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.252308:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439618 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x20a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.252317:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000043c5c2b2 reply state 000000001a07294c transno 4294974968 ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.252485:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043c5c2b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+544:11303:x1862467653390400:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3743us (4093us total) trans 4294974968 rc 0/0 00000100:00100000:2.0:1776187966.252494:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15277 00010000:00010000:3.0:1776187966.252655:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1776187966.252655:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.252661:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.252661:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.252669:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c460bc60 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.252669:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8111509 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.252672:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.252678:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.252681:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.252688:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.252694:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21e:0x0].0x0 (00000000f056c6a6) 00010000:00010000:0.0:1776187966.252695:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20d:0x0].0x0 (0000000090869b29) 00010000:00010000:3.0:1776187966.252696:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.252697:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.252699:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.252699:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.252705:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439634 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.252705:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43963b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.252716:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.252716:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.252717:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.252718:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.252719:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.252719:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.268288:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.268309:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.268316:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.268323:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6dd5963 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.268327:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.268335:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.272152:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0xbfd87aeb (000000007616c5c6) 00010000:00010000:3.0:1776187966.272163:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.272171:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.272182:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439611 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xbfd87aeb bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.272218:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.272225:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.272231:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.272243:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.272246:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.272252:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.272259:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21e:0x0].0x0 (00000000f056c6a6) 00010000:00010000:3.0:1776187966.272261:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.272263:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.272269:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43962d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.274114:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.274217:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653390528 00000100:00100000:3.0:1776187966.274267:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4399 00000100:00100000:3.0:1776187966.274273:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d15dfbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+543:11304:x1862467653390528:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187966.274657:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d15dfbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+544:11304:x1862467653390528:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 382us (553us total) trans 4294974970 rc 0/0 00000100:00100000:3.0:1776187966.274666:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4399 00000100:00100000:0.0:1776187966.277578:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.277667:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653390592 00000100:00100000:2.0:1776187966.277741:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4400 00000100:00100000:2.0:1776187966.277748:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b635321 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+544:11303:x1862467653390592:12345-192.168.204.20@tcp:37:dbench.0 00010000:00010000:1.0:1776187966.278851:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278869:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278896:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278903:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092776876 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.278907:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278914:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278931:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x204a7f30 (0000000079764c80) 00010000:00010000:1.0:1776187966.278935:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.278940:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278945:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43961f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20a:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278968:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278976:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278980:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278985:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d81ab485 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.278987:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278991:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.278998:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20d:0x0].0x0 (0000000090869b29) 00010000:00010000:1.0:1776187966.279000:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.279002:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.279007:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439626 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.285177:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.285275:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653390720 00000100:00100000:3.0:1776187966.285339:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15278 00000100:00100000:3.0:1776187966.285353:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098b0ffb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+545:11304:x1862467653390720:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.285434:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.285467:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000913a9ea0/0x92b1eb87ee431230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x231:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c8587 expref: 545 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.285820:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000529c68e3/0x92b1eb87ee423c40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x231:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3caf expref: 544 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.285836:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e6019cfd/0x92b1eb87ee423ce8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x231:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3cee expref: 543 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.285848:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000b0c02c0/0x92b1eb87ee41edc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x231:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20e0 expref: 542 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.285966:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x231:0x0].0x0 (000000008b8a7782) 00010000:00010000:3.0:1776187966.285985:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.286018:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439642 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.286033:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439642 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.286044:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439642 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.286058:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.286065:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.286071:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.286183:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x231:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.286192:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.286197:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187966.287138:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].402, 64 off33984 00000040:00080000:3.0:1776187966.287160:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4677, 184 off822496 00010000:00010000:3.0:1776187966.287245:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x231:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.287260:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.287271:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.287280:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.287288:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.287293:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x231:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.287312:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187966.287336:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000098b0ffb8 reply state 00000000e2bff596 transno 4294974971 ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x231:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.287533:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.287540:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x231:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.287549:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b9973b27 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.287553:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x231:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.287560:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x231:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.287574:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x231:0x0].0x0 (000000005aa30e07) 00010000:00010000:2.0:1776187966.287578:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.287582:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x231:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.287587:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee439657 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x231:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.287601:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.287602:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.287603:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.290634:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b635321 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+541:11303:x1862467653390592:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 12871us (13051us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.290656:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4400 00010000:00010000:2.0:1776187966.291316:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439642 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.291507:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439642 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.291515:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439642 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.291521:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000900c220d already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.291526:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439642 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.291534:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439642 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.291557:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:2.0:1776187966.291561:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.291566:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439642 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.291577:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439642 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.291592:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000098b0ffb8 reply state 00000000e2bff596 transno 4294974971 ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.295038:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098b0ffb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+541:11304:x1862467653390720:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 6352us (6539us total) trans 4294974971 rc 0/0 00000100:00100000:2.0:1776187966.295057:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15278 00010000:00010000:2.0:1776187966.296067:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296084:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296091:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296097:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000503e410b already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.296101:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296108:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296127:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0xcbe2ca0f (00000000d2ce93fe) 00010000:00010000:2.0:1776187966.296129:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.296134:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296139:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439649 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xcbe2ca0f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296159:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296166:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296171:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296175:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000052d92773 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.296177:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296182:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296190:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x231:0x0].0x0 (000000005aa30e07) 00010000:00010000:2.0:1776187966.296192:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187966.296194:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.296199:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee439650 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x231:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.297076:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.297116:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.297326:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653390912 00000100:00100000:3.0:1776187966.297379:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15279 00000100:00100000:3.0:1776187966.297395:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f9e39f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+540:11384:x1862467653390912:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:3.0:1776187966.297423:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187966.297443:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43965e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caaa2 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.297495:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43965e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa2 expref: 541 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.297508:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43965e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa2 expref: 541 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.297516:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:3.0:1776187966.297519:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.297521:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000547596a2, rc 0) 00000100:00100000:0.0:1776187966.297635:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653390848 00000100:00100000:0.0:1776187966.297668:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4401 00000100:00100000:0.0:1776187966.297684:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca377c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+542:11303:x1862467653390848:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187966.298060:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f9e39f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+543:11384:x1862467653390912:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 672us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.298067:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15279 00000100:00100000:0.0:1776187966.299747:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca377c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+542:11303:x1862467653390848:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 2052us (2664us total) trans 4294974972 rc 0/0 00000100:00100000:0.0:1776187966.299765:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4401 00000100:00100000:0.0:1776187966.300114:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.301128:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653391040 00000100:00100000:1.0:1776187966.301184:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4402 00000100:00100000:1.0:1776187966.301189:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1f10cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+542:11304:x1862467653391040:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.301464:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1f10cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+543:11304:x1862467653391040:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 273us (1351us total) trans 4294974973 rc 0/0 00000100:00100000:1.0:1776187966.301483:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4402 00000100:00100000:2.0:1776187966.306193:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.307177:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653391168 00000100:00100000:3.0:1776187966.307259:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15280 00000100:00100000:3.0:1776187966.307266:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8967a46 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+543:11303:x1862467653391168:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.307350:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1776187966.307400:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000063526244/0x92b1eb87ee42af18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x269:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c6494 expref: 543 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.307424:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000797dd140/0x92b1eb87ee4270f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x269:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4de9 expref: 542 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.307437:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a4664d51/0x92b1eb87ee42715a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x269:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4e13 expref: 541 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.307448:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfe3cbba/0x92b1eb87ee4203de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x269:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29e6 expref: 540 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.307457:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x269:0x0].0x0 (00000000a527ad4c) 00010000:00010000:3.0:1776187966.307487:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43900d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x243:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa5c expref: 539 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.307495:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:3.0:1776187966.307498:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.307533:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.307551:0:12471:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43965e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa2 expref: 538 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.307559:0:12471:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.307601:0:12471:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43965e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa2 expref: 538 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.307614:0:12471:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43965e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa2 expref: 538 pid: 12471 timeout: 543 lvb_type: 0 00000100:00100000:3.0:1776187966.307628:0:12471:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000183af6c5 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12471:1862467659896512:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187966.308799:0:12471:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d138883d going to sleep for 43 seconds 00000100:00100000:2.0:1776187966.309380:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.309974:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653391232 00000100:00100000:3.0:1776187966.310028:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4403 00000100:00100000:3.0:1776187966.310034:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2a2bce pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+539:11384:x1862467653391232:12345-192.168.204.20@tcp:37:ll_sa_11303.0 00010000:00010000:0.0:1776187966.312108:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.313383:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.314341:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653391360 00000100:00100000:3.0:1776187966.314404:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15281 00000100:00100000:3.0:1776187966.314410:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4912074 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+541:11304:x1862467653391360:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.314472:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.314902:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000052e445f1/0x92b1eb87ee431888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x220:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c879b expref: 541 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.314924:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e512471b/0x92b1eb87ee422e71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x220:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3833 expref: 540 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.314938:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008fa9a360/0x92b1eb87ee422ecc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x220:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3856 expref: 539 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.314948:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000074b38dfd/0x92b1eb87ee41e713 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x220:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1dfa expref: 538 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.314957:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x220:0x0].0x0 (000000005e066712) 00010000:00010000:3.0:1776187966.314966:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.315083:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43966c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.315098:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43966c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.315106:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43966c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.315118:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.315125:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.315129:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.315964:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x220:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.315982:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.315990:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187966.316340:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].402, 64 off33984 00000040:00080000:3.0:1776187966.316372:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4678, 184 off822680 00010000:00010000:3.0:1776187966.316433:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x220:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.316442:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.316449:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.316456:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.316463:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.316469:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.316574:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187966.316599:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c4912074 reply state 00000000e316eb54 transno 4294974974 ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x220:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.316629:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.316634:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.316641:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000056c4f2e0 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.316645:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.316654:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.316665:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x220:0x0].0x0 (000000006f67d5a2) 00010000:00010000:3.0:1776187966.316668:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:0.0:1776187966.316936:0:12471:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000183af6c5 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12471:1862467659896512:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187966.316961:0:12471:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.317065:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.317073:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee439681 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x220:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.317085:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.317086:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.317088:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.317124:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43966c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.317132:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43966c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.317138:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43966c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.317144:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030c08888 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.317147:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43966c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.317153:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43966c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.317160:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:3.0:1776187966.317162:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.317164:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43966c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.317169:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43966c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187966.317176:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c4912074 reply state 00000000e316eb54 transno 4294974974 ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.317431:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4912074 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+539:11304:x1862467653391360:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3018us (4053us total) trans 4294974974 rc 0/0 00000100:00100000:3.0:1776187966.317440:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15281 00000100:00100000:1.0:1776187966.323848:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187966.324008:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324026:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324033:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324040:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ba32a0cd already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.324044:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324051:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324070:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0xb65fef2a (0000000037029ea1) 00010000:00010000:2.0:1776187966.324073:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.324078:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324083:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439673 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xb65fef2a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324102:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324107:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324114:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324118:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c2e5f2ee already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.324120:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324124:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324130:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x220:0x0].0x0 (000000006f67d5a2) 00010000:00010000:2.0:1776187966.324132:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187966.324134:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.324139:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43967a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x220:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.325698:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653391488 00000100:00100000:0.0:1776187966.325776:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4404 00000100:00100000:0.0:1776187966.325783:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f1860e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+537:11304:x1862467653391488:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.326070:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f1860e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+538:11304:x1862467653391488:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 286us (2236us total) trans 4294974975 rc 0/0 00000100:00100000:0.0:1776187966.326078:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4404 00000100:00100000:2.0:1776187966.327536:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2a2bce pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+537:11384:x1862467653391232:12345-192.168.204.20@tcp:37:ll_sa_11303.0 Request processed in 17496us (18154us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.327547:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4403 00000100:00100000:1.0:1776187966.331733:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.331777:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.331856:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653391680 00010000:00010000:0.0:1776187966.331928:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43965e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa2 expref: 537 pid: 12471 timeout: 543 lvb_type: 0 00000100:00100000:0.0:1776187966.331964:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4312 00000100:00100000:0.0:1776187966.331972:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085db6b4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+537:2225:x1862467653391680:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1776187966.331987:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187966.331994:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43965e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa2 expref: 537 pid: 12471 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187966.332006:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43965e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa2 expref: 537 pid: 12471 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187966.332027:0:5502:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43965e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa2 expref: 537 pid: 12471 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187966.332043:0:5502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:0.0:1776187966.332047:0:5502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.332057:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.332065:0:5502:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.332090:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187966.332135:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085db6b4a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+536:2225:x1862467653391680:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 163us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.332142:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4312 00010000:00010000:0.0:1776187966.332199:0:12471:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.332218:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.332246:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.332256:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.332264:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.332385:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x269:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.332392:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x269:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.332399:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x269:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187966.332941:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].403, 64 off34048 00000040:00080000:0.0:1776187966.332968:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4679, 184 off822864 00010000:00010000:0.0:1776187966.333041:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x269:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.333053:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x269:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.333062:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x269:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.333075:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x269:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.333082:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x269:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.333089:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x269:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.333715:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653391616 00000100:00100000:3.0:1776187966.333784:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15282 00000100:00100000:3.0:1776187966.333791:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c325c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+537:11304:x1862467653391616:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.333852:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.333900:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008458fce7/0x92b1eb87ee430dad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c83ff expref: 537 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.333928:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4236b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3ae1 expref: 536 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.333940:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001e09006e/0x92b1eb87ee42371c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3b0b expref: 535 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.333950:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000031fadd1e/0x92b1eb87ee41eb6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fdd expref: 534 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.333961:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22b:0x0].0x0 (00000000d7176b01) 00010000:00010000:3.0:1776187966.333971:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.334002:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43969d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.334015:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43969d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.334023:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43969d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.334036:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.334043:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.334049:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.334149:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.334157:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.334163:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.335836:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.335871:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e8967a46 reply state 0000000008d01f2e transno 4294974976 ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x269:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.335959:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.335966:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.335973:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.335978:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007a73b3e2 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.335982:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.335989:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.336008:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:0.0:1776187966.336011:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.336014:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.336020:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee439665 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.336029:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e8967a46 reply state 0000000008d01f2e transno 4294974976 ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.336121:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8967a46 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+534:11303:x1862467653391168:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 28851us (29933us total) trans 4294974976 rc 0/0 00000100:00100000:0.0:1776187966.336130:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15280 00010000:00010000:2.0:1776187966.337923:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.337932:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x269:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.337948:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d042148c already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.337952:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x269:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.337964:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x269:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.337981:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x269:0x0].0x0 (00000000693f1349) 00010000:00010000:2.0:1776187966.337984:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.337988:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x269:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.337993:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee439696 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x269:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.338007:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.338008:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.338009:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.340469:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340497:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340505:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340512:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007072c805 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.340517:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340526:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340552:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0xa3962d5b (00000000219adb48) 00010000:00010000:0.0:1776187966.340556:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.340562:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340569:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee439688 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xa3962d5b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340594:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x269:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340600:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x269:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340606:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x269:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340611:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.340613:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x269:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340618:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x269:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340626:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x269:0x0].0x0 (00000000693f1349) 00010000:00010000:0.0:1776187966.340628:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.340630:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x269:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.340641:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43968f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x269:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.341200:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000040:00080000:1.0:1776187966.341974:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].404, 64 off34112 00000040:00080000:1.0:1776187966.342000:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4680, 184 off823048 00010000:00010000:1.0:1776187966.342085:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342104:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342114:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342122:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342128:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342133:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342150:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.342172:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001c325c88 reply state 0000000093797f0f transno 4294974977 ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342235:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43969d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342241:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43969d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342249:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43969d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342254:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030c08888 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.342258:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43969d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342265:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43969d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342280:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:1.0:1776187966.342282:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.342286:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43969d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.342292:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43969d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.342302:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001c325c88 reply state 0000000093797f0f transno 4294974977 ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.342413:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c325c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+534:11304:x1862467653391616:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 8619us (10686us total) trans 4294974977 rc 0/0 00000100:00100000:1.0:1776187966.342424:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15282 00010000:00010000:0.0:1776187966.342596:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.342602:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.342611:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9325880 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.342614:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.342621:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.342631:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22b:0x0].0x0 (000000005aa30e07) 00010000:00010000:0.0:1776187966.342633:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.342635:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.342640:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee4396b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.342650:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.342652:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.342653:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.344708:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344733:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344742:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344748:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000056c4f2e0 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.344752:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344761:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344779:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0xee1a16ec (000000003846d7f8) 00010000:00010000:1.0:1776187966.344782:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.344786:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344792:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee4396a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xee1a16ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344817:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344823:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344828:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344834:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ac819bc1 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.344835:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344841:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344848:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22b:0x0].0x0 (000000005aa30e07) 00010000:00010000:1.0:1776187966.344851:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.344853:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.344857:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.345196:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653391808 00000100:00100000:2.0:1776187966.345369:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4405 00000100:00100000:2.0:1776187966.345376:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f1d31b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+533:11303:x1862467653391808:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.345657:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f1d31b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+534:11303:x1862467653391808:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 280us (4464us total) trans 4294974978 rc 0/0 00000100:00100000:2.0:1776187966.345665:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4405 00000100:00100000:0.0:1776187966.349500:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.352757:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.353230:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653391936 00000100:00100000:1.0:1776187966.353308:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4406 00000100:00100000:1.0:1776187966.353316:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b160d9df pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+534:11304:x1862467653391936:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.353626:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b160d9df pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+535:11304:x1862467653391936:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 308us (4134us total) trans 4294974979 rc 0/0 00000100:00100000:1.0:1776187966.353634:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4406 00000100:00100000:1.0:1776187966.353710:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653392064 00000100:00100000:1.0:1776187966.353736:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15283 00000100:00100000:1.0:1776187966.353740:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000776008e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+535:11303:x1862467653392064:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.353806:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.353844:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a28ecafc/0x92b1eb87ee42b029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x256:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c64f6 expref: 535 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.353868:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000054b0d5ec/0x92b1eb87ee425dcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x256:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c47ad expref: 534 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.353913:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004b409488/0x92b1eb87ee425e8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x256:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c47ec expref: 533 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.353924:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f6518e7/0x92b1eb87ee41fc75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x256:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26ba expref: 532 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.353935:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x256:0x0].0x0 (00000000bd7a3a8d) 00010000:00010000:1.0:1776187966.353944:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.353992:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4396b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354011:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4396b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354021:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4396b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354036:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354043:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354049:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354143:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x256:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354155:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354160:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.354526:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].403, 64 off34048 00000040:00080000:1.0:1776187966.354548:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4681, 184 off823232 00010000:00010000:1.0:1776187966.354599:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x256:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354609:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354617:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354624:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354631:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354637:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354666:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.354682:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000776008e6 reply state 00000000a03e9dca transno 4294974980 ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x256:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354712:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187966.354718:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354724:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187966.354729:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354736:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354745:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x256:0x0].0x0 (00000000194664fe) 00010000:00010000:1.0:1776187966.354748:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187966.354751:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 1/0,0 mode: --/PW res: [0x200000401:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354756:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4396ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x256:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354766:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.354767:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.354769:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.354954:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4396b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354961:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4396b9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354978:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4396b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354984:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000787789d5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.354987:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4396b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354991:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4396b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.354998:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:1.0:1776187966.355001:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.355003:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4396b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.355008:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee4396b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.355015:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000776008e6 reply state 00000000a03e9dca transno 4294974980 ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.355081:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000776008e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+533:11303:x1862467653392064:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1338us (2332us total) trans 4294974980 rc 0/0 00000100:00100000:1.0:1776187966.355089:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15283 00000100:00100000:0.0:1776187966.363128:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.363221:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653392192 00000100:00100000:1.0:1776187966.363287:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15284 00000100:00100000:1.0:1776187966.363294:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d89ed77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+533:11304:x1862467653392192:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.363365:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.363399:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd28f6f0/0x92b1eb87ee423038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x222:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c38d4 expref: 533 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363427:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092acced9/0x92b1eb87ee41e7f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x222:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e5c expref: 532 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363442:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fbcd82a6/0x92b1eb87ee423093 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x222:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c38f0 expref: 531 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363452:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a9b9da09/0x92b1eb87ee41e7d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x222:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e47 expref: 530 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363461:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x222:0x0].0x0 (00000000050ac7ce) 00010000:00010000:1.0:1776187966.363471:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.363503:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4396d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363517:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4396d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363527:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4396d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363540:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363546:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363552:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363665:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x222:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363684:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.363691:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.364743:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].404, 64 off34112 00000040:00080000:1.0:1776187966.364768:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4682, 184 off823416 00010000:00010000:1.0:1776187966.364837:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x222:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.364851:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.364861:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.364869:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.364896:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.364902:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.364925:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.364946:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009d89ed77 reply state 00000000cf85daaa transno 4294974981 ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x222:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.365040:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.365046:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.365053:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c460bc60 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.365057:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.365064:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.365076:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x222:0x0].0x0 (000000008d2350fb) 00010000:00010000:2.0:1776187966.365078:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.365081:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 1/0,0 mode: --/PW res: [0x200000401:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.365086:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee4396ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x222:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.365099:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.365100:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.365101:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.365177:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4396d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.365186:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4396d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.365192:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4396d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.365197:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0ab918b already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.365200:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4396d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.365574:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4396d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.365584:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:1.0:1776187966.365586:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.365588:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4396d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.365593:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4396d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.365605:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009d89ed77 reply state 00000000cf85daaa transno 4294974981 ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.366083:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d89ed77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+531:11304:x1862467653392192:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2784us (2959us total) trans 4294974981 rc 0/0 00000100:00100000:1.0:1776187966.366092:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15284 00010000:00010000:1.0:1776187966.372529:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372554:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372562:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372570:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.372574:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372583:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372600:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x2ee4e5f8 (000000006c0357c0) 00010000:00010000:1.0:1776187966.372604:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.372608:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372615:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee4396c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x2ee4e5f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372639:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372645:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372650:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372656:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.372658:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372664:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372683:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x256:0x0].0x0 (00000000194664fe) 00010000:00010000:1.0:1776187966.372686:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.372688:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.372694:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4396c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x256:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.372905:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.377110:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653392320 00000100:00100000:2.0:1776187966.377184:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4407 00000100:00100000:2.0:1776187966.377190:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+530:11303:x1862467653392320:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.378256:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+531:11303:x1862467653392320:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 1061us (5352us total) trans 4294974982 rc 0/0 00000100:00100000:2.0:1776187966.378267:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4407 00000100:00100000:3.0:1776187966.378569:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f1d31b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:124909f8-d332-49c6-a146-b122e3595f63:2993:1862467659896576:0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.378633:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187966.378660:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002ba02658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2993:1862467659896832:0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.378786:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187966.378809:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1776187966.378823:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068f8989e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2993:1862467659896640:0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.378846:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187966.378862:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c697eec4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659896896:0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.378905:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187966.378935:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000183af6c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2995:1862467659896704:0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.378957:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187966.378986:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1776187966.378991:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000812af665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659896768:0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.379015:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187966.379057:0:5508:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659896576 00000100:00100000:3.0:1776187966.379097:0:5508:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1776187966.379104:0:5508:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef65ed52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124909f8-d332-49c6-a146-b122e3595f63+18:2993:x1862467659896576:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.379157:0:5508:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef65ed52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124909f8-d332-49c6-a146-b122e3595f63+18:2993:x1862467659896576:12345-0@lo:400:kworker/u8:5.0 Request processed in 53us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.379163:0:5508:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1776187966.379194:0:11797:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659896896 00000100:00100000:3.0:1776187966.379227:0:11797:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659896768 00000100:00100000:3.0:1776187966.379246:0:11797:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1776187966.379250:0:11797:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b166f79 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:2993:x1862467659896896:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.379281:0:11797:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b166f79 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:2993:x1862467659896896:12345-0@lo:400:kworker/u8:5.0 Request processed in 30us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.379287:0:11797:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1776187966.379297:0:11797:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1776187966.379300:0:11797:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cee9f505 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:2995:x1862467659896768:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.379324:0:11797:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cee9f505 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:2995:x1862467659896768:12345-0@lo:400:kworker/u8:5.0 Request processed in 23us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.379330:0:11797:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1776187966.380273:0:2993:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968148 gen 2 00000004:00080000:3.0:1776187966.380282:0:2993:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000031f2b725, transno 4294968148 00000100:00100000:2.0:1776187966.380292:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.380304:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c697eec4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659896896:0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.380321:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f1d31b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:124909f8-d332-49c6-a146-b122e3595f63:2993:1862467659896576:0@lo:400:kworker/u8:5.0 00000100:00100000:2.0:1776187966.380328:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653392448 00000100:00100000:2.0:1776187966.380367:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4408 00000100:00100000:2.0:1776187966.380386:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007868c699 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+531:11304:x1862467653392448:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.380644:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007868c699 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+532:11304:x1862467653392448:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 257us (355us total) trans 4294974983 rc 0/0 00000100:00100000:2.0:1776187966.380655:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4408 00000100:00100000:0.0:1776187966.382719:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659896832 00000100:00100000:0.0:1776187966.382780:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659896640 00000100:00100000:0.0:1776187966.382814:0:10981:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659896704 00000100:00100000:0.0:1776187966.382835:0:10981:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1776187966.382841:0:10981:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066529f31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1862467659896832:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187966.382929:0:10981:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066529f31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2993:x1862467659896832:12345-0@lo:400:kworker/u8:5.0 Request processed in 88us (4143us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.382935:0:10981:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1776187966.382949:0:10981:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1776187966.382952:0:10981:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ddaf998f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1862467659896640:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187966.383238:0:10981:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ddaf998f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2993:x1862467659896640:12345-0@lo:400:kworker/u8:5.0 Request processed in 284us (4391us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.383244:0:10981:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1776187966.383255:0:10981:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1776187966.383258:0:10981:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000046fcb93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2995:x1862467659896704:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187966.383284:0:10981:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000046fcb93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2995:x1862467659896704:12345-0@lo:400:kworker/u8:5.0 Request processed in 24us (4327us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.383289:0:10981:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00010000:1.0:1776187966.386134:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386150:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386157:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386165:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.386169:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386176:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386194:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x5a3b2e4f (00000000e5f011d9) 00010000:00010000:1.0:1776187966.386198:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.386211:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386217:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee4396dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0x5a3b2e4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386240:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386246:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386251:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386256:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6dd5963 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.386258:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386263:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386271:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x222:0x0].0x0 (000000008d2350fb) 00010000:00010000:1.0:1776187966.386274:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.386275:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.386280:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4396e3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x222:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.386858:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068f8989e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2993:1862467659896640:0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.386919:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002ba02658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2993:1862467659896832:0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187966.386959:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003bd4f7d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659896960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1776187966.387027:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187966.387059:0:2995:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968124 gen 2 00000004:00080000:3.0:1776187966.387063:0:2995:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000033b3298, transno 4294968116 00000004:00080000:3.0:1776187966.387076:0:2995:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000ed9b3b81, transno 4294968117 00000004:00080000:3.0:1776187966.387080:0:2995:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000000b916d83, transno 4294968120 00000004:00080000:3.0:1776187966.387083:0:2995:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000048ad97c4, transno 4294968121 00000004:00080000:3.0:1776187966.387086:0:2995:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000005b4f1da6, transno 4294968122 00000004:00080000:3.0:1776187966.387089:0:2995:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000005ac78150, transno 4294968123 00000004:00080000:3.0:1776187966.387093:0:2995:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000b9c2e81b, transno 4294968124 00000100:00100000:3.0:1776187966.387097:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000812af665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659896768:0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187966.387101:0:7603:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659896960 00000100:00100000:3.0:1776187966.387111:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000183af6c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2995:1862467659896704:0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187966.387149:0:7603:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1776187966.387155:0:7603:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ba02658 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2995:x1862467659896960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1776187966.387192:0:7603:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 17039360 granted 281083904 pending 8519680 free 3807379456 avail 3805282304 00000100:00100000:0.0:1776187966.387252:0:7603:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ba02658 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2995:x1862467659896960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.387261:0:7603:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000004:00080000:3.0:1776187966.387425:0:6807:0:(osp_sync.c:1124:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 34 changes, 0 in progress, 0 in flight, 7 done 00000100:00100000:1.0:1776187966.387601:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.387701:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.387777:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003bd4f7d8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659896960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1776187966.388522:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653392576 00000100:00100000:0.0:1776187966.388600:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653392704 00000100:00100000:3.0:1776187966.388639:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15285 00000100:00100000:3.0:1776187966.388647:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2d9c0b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+532:11303:x1862467653392576:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.388705:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.388729:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004236a14f/0x92b1eb87ee426fcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x267:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4d79 expref: 532 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.388754:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000833d7ef6/0x92b1eb87ee420360 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x267:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29a0 expref: 531 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.388765:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008411707a/0x92b1eb87ee427050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x267:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4daa expref: 530 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.388776:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000039d9af4d/0x92b1eb87ee42033d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x267:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2992 expref: 529 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.388785:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x267:0x0].0x0 (00000000c1373173) 00010000:00010000:3.0:1776187966.388793:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.388824:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4396f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.388838:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4396f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.388846:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4396f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.388859:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.388866:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.388871:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.389058:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15286 00000100:00100000:2.0:1776187966.389064:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080411f53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+528:11304:x1862467653392704:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.389088:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.389102:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006ebde655/0x92b1eb87ee430bfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x225:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c8365 expref: 528 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.389116:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004c7d2d07/0x92b1eb87ee423309 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x225:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c39ad expref: 527 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.389128:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000f92675b/0x92b1eb87ee423387 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x225:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c39de expref: 526 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.389138:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000201d0133/0x92b1eb87ee41e92e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x225:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ee8 expref: 525 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.389148:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x225:0x0].0x0 (00000000a5ba8e80) 00010000:00010000:3.0:1776187966.389259:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x267:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.389270:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.389276:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.389783:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.389805:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439706 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.389819:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439706 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.389828:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439706 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.389842:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.389851:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.389858:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187966.389941:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].405, 64 off34176 00000040:00080000:3.0:1776187966.389965:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4683, 184 off823600 00010000:00010000:2.0:1776187966.390088:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x225:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.390099:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.390106:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.390378:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].406, 64 off34240 00010000:00010000:3.0:1776187966.390616:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x267:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390628:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390636:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390643:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390649:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390655:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390774:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187966.390794:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e2d9c0b7 reply state 00000000a490ce07 transno 4294974984 ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x267:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390841:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4396f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390848:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4396f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390858:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4396f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390863:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035ee1513 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.390866:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4396f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390896:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4396f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390911:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:3.0:1776187966.390913:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.390916:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4396f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.390921:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4396f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187966.390931:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e2d9c0b7 reply state 00000000a490ce07 transno 4294974984 ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.391023:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.391029:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.391037:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000056c4f2e0 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.391040:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.391046:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.391055:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x267:0x0].0x0 (00000000adef1ff2) 00010000:00010000:2.0:1776187966.391057:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.391060:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.391066:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43971b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x267:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.391077:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.391079:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.391080:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187966.391436:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2d9c0b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+526:11303:x1862467653392576:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2785us (3832us total) trans 4294974984 rc 0/0 00000100:00100000:3.0:1776187966.391516:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15285 00000040:00080000:1.0:1776187966.391624:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4684, 184 off823784 00010000:00010000:1.0:1776187966.393364:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x225:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393390:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x225:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393400:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x225:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393408:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x225:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393413:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x225:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393420:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x225:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393451:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.393473:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000080411f53 reply state 000000007bdf7d45 transno 4294974985 ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x225:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393535:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439706 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393541:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439706 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393546:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439706 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393552:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aea18492 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.393555:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439706 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393562:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439706 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393574:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:1.0:1776187966.393577:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.393581:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439706 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.393587:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439706 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.393596:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000080411f53 reply state 000000007bdf7d45 transno 4294974985 ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.393714:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080411f53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+527:11304:x1862467653392704:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 4647us (6012us total) trans 4294974985 rc 0/0 00000100:00100000:1.0:1776187966.393724:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15286 00010000:00010000:3.0:1776187966.394326:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.394331:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x225:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.394352:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000787789d5 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.394355:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x225:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.394361:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x225:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.394370:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x225:0x0].0x0 (000000007659c27e) 00010000:00010000:3.0:1776187966.394372:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.394374:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x225:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.394379:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439722 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x225:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.394391:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.394392:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.394394:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.395118:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395129:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395135:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395141:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000005bf1cdd already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.395144:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395149:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395158:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0xbea011c (00000000d2ce93fe) 00010000:00010000:2.0:1776187966.395160:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.395163:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395168:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee4396f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xbea011c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395184:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395190:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395195:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395200:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ac819bc1 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.395217:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395222:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395228:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x267:0x0].0x0 (00000000adef1ff2) 00010000:00010000:2.0:1776187966.395231:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187966.395233:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.395238:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee4396ff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x267:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398502:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398523:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398531:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398538:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000597b6781 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.398542:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398550:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398569:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0xd60b5417 (00000000d80c9c1b) 00010000:00010000:1.0:1776187966.398573:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.398577:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398583:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee43970d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xd60b5417 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398604:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398610:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398615:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398622:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.398624:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398630:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398638:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x225:0x0].0x0 (000000007659c27e) 00010000:00010000:1.0:1776187966.398641:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.398642:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.398647:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439714 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x225:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.403751:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.403845:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653392832 00000100:00100000:0.0:1776187966.403942:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4409 00000100:00100000:0.0:1776187966.403950:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c6fe787 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+525:11304:x1862467653392832:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.404214:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c6fe787 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+526:11304:x1862467653392832:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 253us (462us total) trans 4294974986 rc 0/0 00000100:00100000:0.0:1776187966.404222:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4409 00000100:00100000:2.0:1776187966.406453:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.406557:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653392960 00000100:00100000:0.0:1776187966.406616:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4410 00000100:00100000:0.0:1776187966.406623:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb672dd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+526:11303:x1862467653392960:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.406863:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb672dd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+527:11303:x1862467653392960:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 240us (420us total) trans 4294974987 rc 0/0 00000100:00100000:0.0:1776187966.406872:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4410 00000100:00100000:0.0:1776187966.412366:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.412449:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.412699:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653393088 00000100:00100000:1.0:1776187966.412764:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653393216 00000100:00100000:1.0:1776187966.412823:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15287 00000100:00100000:1.0:1776187966.412830:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b518a13a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+528:11304:x1862467653393088:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.412915:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.412946:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e3d4bf7f/0x92b1eb87ee431516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c8683 expref: 528 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413080:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc16a705/0x92b1eb87ee423ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x22f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3c31 expref: 527 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413097:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e205b83/0x92b1eb87ee423af7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3c4d expref: 526 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413108:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c1c315b7/0x92b1eb87ee41ed02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x22f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c208c expref: 525 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413123:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22f:0x0].0x0 (000000008f80b2f7) 00010000:00010000:1.0:1776187966.413134:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.413172:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439729 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413187:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413197:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413219:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413226:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413231:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413594:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413604:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.413611:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.414234:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].407, 64 off34304 00000040:00080000:1.0:1776187966.414256:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4685, 176 off823960 00010000:00010000:1.0:1776187966.414318:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414328:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414337:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414355:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414362:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414367:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414391:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.414410:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b518a13a reply state 00000000fd703f0f transno 4294974988 ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414433:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187966.414437:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414445:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187966.414448:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414454:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414475:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22f:0x0].0x0 (00000000e5f011d9) 00010000:00010000:1.0:1776187966.414478:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187966.414481:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414487:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43973e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x22f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414499:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.414500:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.414501:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.414536:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414547:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439729 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414552:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439729 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414557:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6dd5963 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.414559:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439729 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414564:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439729 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414571:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:1.0:1776187966.414573:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.414575:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439729 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.414580:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439729 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.414587:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b518a13a reply state 00000000fd703f0f transno 4294974988 ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.414662:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b518a13a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+526:11304:x1862467653393088:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1831us (2304us total) trans 4294974988 rc 0/0 00000100:00100000:1.0:1776187966.415121:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15287 00000100:00100000:1.0:1776187966.418622:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15288 00000100:00100000:1.0:1776187966.418636:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d15dfbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+525:11303:x1862467653393216:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.419096:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.419129:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000706827c4/0x92b1eb87ee42a2f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x248:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c6011 expref: 525 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.419152:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa176e68/0x92b1eb87ee42500c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x248:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4331 expref: 524 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.419165:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005eccc33a/0x92b1eb87ee425044 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x248:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4346 expref: 523 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.419176:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e6345a4/0x92b1eb87ee41f70b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x248:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2460 expref: 522 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.419185:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x248:0x0].0x0 (00000000c868a7c3) 00010000:00010000:1.0:1776187966.419194:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.419237:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439745 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.419253:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439745 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.419264:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439745 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.419281:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.419288:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.419294:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.419959:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x248:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.420078:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.420087:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.420644:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].405, 64 off34176 00000040:00080000:1.0:1776187966.420743:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4686, 184 off824144 00010000:00010000:1.0:1776187966.420809:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x248:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.420822:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.420831:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.420840:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.420846:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.420856:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.420905:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.420925:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005d15dfbd reply state 000000004752b9d9 transno 4294974989 ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x248:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.421138:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.421144:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.421152:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.421156:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.421163:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.421180:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x248:0x0].0x0 (000000006c0357c0) 00010000:00010000:3.0:1776187966.421184:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.421187:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.421193:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43975a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x248:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.421214:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.421216:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.421218:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.421317:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439745 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.421324:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439745 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.421331:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439745 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.421337:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0ab918b already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.421346:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439745 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.421352:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439745 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.421361:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:1.0:1776187966.421363:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.421365:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439745 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.421370:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439745 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.421380:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000005d15dfbd reply state 000000004752b9d9 transno 4294974989 ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.421522:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d15dfbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+523:11303:x1862467653393216:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2885us (9070us total) trans 4294974989 rc 0/0 00000100:00100000:1.0:1776187966.421532:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15288 00000100:00100000:0.0:1776187966.422699:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.422772:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653393344 00000100:00100000:3.0:1776187966.422821:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4411 00000100:00100000:3.0:1776187966.422827:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077da40a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+523:11304:x1862467653393344:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187966.424564:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077da40a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+524:11304:x1862467653393344:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 1727us (1861us total) trans 4294974990 rc 0/0 00000100:00100000:3.0:1776187966.424579:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4411 00010000:00010000:1.0:1776187966.425075:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425088:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425096:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425103:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.425106:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425114:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425134:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x5e0db83a (00000000194664fe) 00010000:00010000:1.0:1776187966.425137:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.425141:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425147:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43974c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x5e0db83a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425165:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425171:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425177:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425181:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006aa2e88c already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.425183:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425188:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425196:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x248:0x0].0x0 (000000006c0357c0) 00010000:00010000:1.0:1776187966.425198:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.425200:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425217:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439753 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x248:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425241:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425248:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425258:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425264:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.425265:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425271:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425278:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x9062bf83 (000000008d2350fb) 00010000:00010000:1.0:1776187966.425280:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.425282:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425287:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439730 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0x9062bf83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425300:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425305:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425310:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425315:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.425317:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425322:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425329:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22f:0x0].0x0 (00000000e5f011d9) 00010000:00010000:1.0:1776187966.425331:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.425333:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.425339:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439737 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x22f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.427638:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.427702:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653393472 00000100:00100000:2.0:1776187966.427759:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15289 00000100:00100000:2.0:1776187966.427766:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c697eec4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+522:11304:x1862467653393472:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.427866:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.427917:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e2095cbf/0x92b1eb87ee430cf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x229:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c83b9 expref: 522 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.427937:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000103394cb/0x92b1eb87ee42357f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x229:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3a7f expref: 521 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.427948:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000715da01d/0x92b1eb87ee4235a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x229:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3a8d expref: 520 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.427958:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ade24ce4/0x92b1eb87ee41eaa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x229:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f89 expref: 519 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.429122:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x229:0x0].0x0 (000000002963c767) 00010000:00010000:2.0:1776187966.429144:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.429180:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439761 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.429196:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.429215:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.429229:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.429236:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.429247:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.429790:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x229:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.429802:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.429809:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.430295:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].408, 64 off34368 00000040:00080000:2.0:1776187966.430316:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4687, 184 off824328 00010000:00010000:2.0:1776187966.430655:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x229:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430766:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430776:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430785:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430790:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430800:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430832:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.430855:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c697eec4 reply state 00000000fa81713f transno 4294974991 ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x229:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430924:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439761 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430931:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439761 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430937:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430943:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009d004fc already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.430946:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439761 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430953:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439761 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.430963:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:2.0:1776187966.431082:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.431088:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439761 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.431095:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439761 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.431105:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c697eec4 reply state 00000000fa81713f transno 4294974991 ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.431146:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.431153:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.431162:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000597b6781 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.431166:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.431173:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.431184:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x229:0x0].0x0 (00000000780f5f5c) 00010000:00010000:3.0:1776187966.431187:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.431190:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.431195:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439776 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x229:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.431218:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.431220:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.431221:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.431242:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c697eec4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+520:11304:x1862467653393472:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3472us (3612us total) trans 4294974991 rc 0/0 00000100:00100000:2.0:1776187966.431252:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15289 00000100:00100000:2.0:1776187966.438661:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.438854:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1776187966.438913:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.438928:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.438935:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.438941:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000791f3e8c already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.438945:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.438952:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.438983:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x801dd473 (000000007e00579b) 00010000:00010000:1.0:1776187966.438986:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.438991:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.438997:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439768 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0x801dd473 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.439018:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.439025:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.439030:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.439035:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.439037:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.439043:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.439050:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x229:0x0].0x0 (00000000780f5f5c) 00010000:00010000:1.0:1776187966.439052:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.439054:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.439060:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43976f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x229:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.439628:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653393600 00000100:00100000:0.0:1776187966.439695:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653393728 00000100:00100000:0.0:1776187966.439726:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4412 00000100:00100000:0.0:1776187966.439733:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007274c9e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+520:11303:x1862467653393600:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.440017:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007274c9e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+521:11303:x1862467653393600:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 283us (1363us total) trans 4294974992 rc 0/0 00000100:00100000:0.0:1776187966.440024:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4412 00000100:00100000:0.0:1776187966.440072:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4413 00000100:00100000:0.0:1776187966.440076:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e10840f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+520:11304:x1862467653393728:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.440157:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e10840f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+521:11304:x1862467653393728:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 79us (1304us total) trans 4294974993 rc 0/0 00000100:00100000:0.0:1776187966.440164:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4413 00000100:00100000:0.0:1776187966.444689:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.444723:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.445089:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653393856 00000100:00100000:3.0:1776187966.445167:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653393984 00000100:00100000:3.0:1776187966.445194:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15290 00000100:00100000:3.0:1776187966.445208:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077da40a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+522:11303:x1862467653393856:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.445271:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.445299:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000051c2be2c/0x92b1eb87ee42af50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c64a9 expref: 522 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445322:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d77640d2/0x92b1eb87ee4255c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c44ff expref: 521 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445334:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a133bf86/0x92b1eb87ee425648 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4530 expref: 520 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445357:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5550917/0x92b1eb87ee41f97a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c256a expref: 519 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445373:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24e:0x0].0x0 (00000000c16e7abc) 00010000:00010000:3.0:1776187966.445383:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.445419:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee43977d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445433:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee43977d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445442:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee43977d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445456:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445462:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445469:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445570:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445578:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.445584:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.445798:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15291 00000100:00100000:1.0:1776187966.445804:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079b86e0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+518:11304:x1862467653393984:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.445829:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.445842:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002ec52e7d/0x92b1eb87ee430c80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x227:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c8396 expref: 518 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.445858:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000286b8072/0x92b1eb87ee423498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x227:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3a40 expref: 517 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.445871:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e6a8f941/0x92b1eb87ee4234e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x227:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3a55 expref: 516 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.445911:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007f4db6cd/0x92b1eb87ee41e9f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x227:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f3c expref: 515 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.445918:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x227:0x0].0x0 (000000001bb5b764) 00010000:00010000:1.0:1776187966.445925:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.445940:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439792 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.445950:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439792 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.445957:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439792 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.445985:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.445993:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446000:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446056:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x227:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446064:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446071:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.446441:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].409, 64 off34432 00000040:00080000:1.0:1776187966.446463:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4688, 184 off824512 00010000:00010000:1.0:1776187966.446517:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x227:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446527:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446534:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446541:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446547:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446558:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446579:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.446594:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000079b86e0f reply state 00000000836ec7e5 transno 4294974994 ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x227:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446616:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187966.446620:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446627:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187966.446631:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446637:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446646:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x227:0x0].0x0 (000000008d2350fb) 00010000:00010000:1.0:1776187966.446648:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187966.446650:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446655:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x227:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.446665:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.446667:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.447236:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.447282:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439792 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.447293:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439792 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.447298:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439792 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.447302:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.447305:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439792 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.447310:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439792 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.447319:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:1.0:1776187966.447322:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.447324:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439792 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.447329:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439792 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.447779:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000079b86e0f reply state 00000000836ec7e5 transno 4294974994 ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.447896:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079b86e0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+516:11304:x1862467653393984:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2088us (3170us total) trans 4294974994 rc 0/0 00000100:00100000:1.0:1776187966.447905:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15291 00000040:00080000:3.0:1776187966.449797:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].406, 64 off34240 00000040:00080000:3.0:1776187966.449833:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4689, 184 off824696 00010000:00010000:3.0:1776187966.449949:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.449969:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.449982:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.449990:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.449996:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.450002:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.450029:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187966.450050:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000077da40a8 reply state 000000005d7f473a transno 4294974995 ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.450104:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee43977d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.450110:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee43977d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.450116:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee43977d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.450122:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035ee1513 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.450125:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee43977d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.450132:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee43977d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.450147:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:3.0:1776187966.450149:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.450155:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee43977d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.450162:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee43977d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187966.450172:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000077da40a8 reply state 000000005d7f473a transno 4294974995 ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.450278:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077da40a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+517:11303:x1862467653393856:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 5075us (5593us total) trans 4294974995 rc 0/0 00000100:00100000:3.0:1776187966.450288:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15290 00010000:00010000:2.0:1776187966.451092:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.451101:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.451111:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000547596a2 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.451114:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.451120:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.451130:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24e:0x0].0x0 (0000000015f09a80) 00010000:00010000:2.0:1776187966.451132:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.451135:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 1/0,0 mode: --/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.451140:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee4397ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.451158:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.451160:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.451161:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.451289:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451299:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451306:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451312:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.451314:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451319:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451327:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x1e0192a5 (00000000e5f011d9) 00010000:00010000:3.0:1776187966.451330:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.451332:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451338:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439799 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0x1e0192a5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451596:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451602:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451607:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451612:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006aa2e88c already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.451614:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451620:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451628:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x227:0x0].0x0 (000000008d2350fb) 00010000:00010000:3.0:1776187966.451630:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.451632:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.451637:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee4397a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x227:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.454531:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1776187966.454679:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454693:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454700:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454707:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030c08888 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.454711:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454719:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454736:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x1674e29a (0000000004f0a071) 00010000:00010000:1.0:1776187966.454738:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.454743:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454749:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee439784 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x1674e29a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454781:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454787:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454792:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454798:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007a73b3e2 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.454801:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454806:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454813:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24e:0x0].0x0 (0000000015f09a80) 00010000:00010000:1.0:1776187966.454815:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.454817:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.454823:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43978b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.455010:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653394112 00000100:00100000:3.0:1776187966.455063:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4414 00000100:00100000:3.0:1776187966.455069:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004db8712a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+515:11304:x1862467653394112:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187966.455323:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004db8712a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+516:11304:x1862467653394112:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 253us (799us total) trans 4294974996 rc 0/0 00000100:00100000:3.0:1776187966.455331:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4414 00000100:00100000:0.0:1776187966.459477:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.460737:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653394240 00000100:00100000:1.0:1776187966.461196:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15292 00000100:00100000:1.0:1776187966.461212:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000896208e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+516:11304:x1862467653394240:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.461270:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.461296:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e78c29c3/0x92b1eb87ee430938 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x224:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c8277 expref: 516 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461318:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005b1b25f6/0x92b1eb87ee42320d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x224:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3959 expref: 515 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461329:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000070b54e6d/0x92b1eb87ee423268 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x224:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c397c expref: 514 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461363:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000014bd7a8f/0x92b1eb87ee41e89b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x224:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ea2 expref: 513 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461372:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x224:0x0].0x0 (0000000077f1783a) 00010000:00010000:1.0:1776187966.461381:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.461410:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4397b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461426:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4397b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461436:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4397b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461450:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461456:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461462:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461559:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x224:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461567:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.461578:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.461959:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].407, 64 off34304 00000040:00080000:1.0:1776187966.462237:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4690, 184 off824880 00010000:00010000:1.0:1776187966.462302:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x224:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462315:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462322:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462329:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462335:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462340:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462367:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.462385:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000896208e reply state 0000000098cdd15c transno 4294974997 ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x224:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462429:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4397b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462436:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4397b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462441:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4397b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462446:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.462450:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4397b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462456:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4397b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462465:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:1.0:1776187966.462468:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.462470:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4397b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.462476:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4397b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x21c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.462484:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000896208e reply state 0000000098cdd15c transno 4294974997 ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.462562:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000896208e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+514:11304:x1862467653394240:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1349us (3093us total) trans 4294974997 rc 0/0 00000100:00100000:1.0:1776187966.462570:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15292 00010000:00010000:3.0:1776187966.462660:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.462665:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.462672:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6dd5963 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.462675:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.462682:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.462691:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x224:0x0].0x0 (00000000194664fe) 00010000:00010000:3.0:1776187966.462693:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.462694:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 1/0,0 mode: --/PW res: [0x200000401:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.462699:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee4397ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x224:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.462709:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.462711:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.462712:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187966.463860:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.464720:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653394368 00000100:00100000:2.0:1776187966.464778:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4415 00000100:00100000:2.0:1776187966.464785:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c0f5dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+514:11303:x1862467653394368:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.465061:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c0f5dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+515:11303:x1862467653394368:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 275us (1207us total) trans 4294974998 rc 0/0 00000100:00100000:2.0:1776187966.465069:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4415 00010000:00010000:3.0:1776187966.469194:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469224:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469232:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469240:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.469244:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469252:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469269:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0xc5f130b7 (000000006c0357c0) 00010000:00010000:3.0:1776187966.469273:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.469277:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469283:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee4397bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x21c:0x0].0xc5f130b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469307:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469314:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469320:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469324:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0ab918b already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.469326:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469330:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469336:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x224:0x0].0x0 (00000000194664fe) 00010000:00010000:3.0:1776187966.469338:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.469340:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.469345:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee4397c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x224:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.474948:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.476354:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.476628:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653394496 00000100:00100000:0.0:1776187966.476699:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15293 00000100:00100000:0.0:1776187966.476706:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066f354e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+514:11303:x1862467653394496:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.476775:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187966.476807:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e436147b/0x92b1eb87ee42b084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x258:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c6519 expref: 514 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.476830:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008100a9b2/0x92b1eb87ee425ff6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x258:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4871 expref: 513 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.476842:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005fbd567b/0x92b1eb87ee42602e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x258:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4886 expref: 512 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.476850:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000076c413f/0x92b1eb87ee41fd39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x258:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c270e expref: 511 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.476859:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x258:0x0].0x0 (000000008523bc6e) 00010000:00010000:0.0:1776187966.476869:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.476926:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4397d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.476946:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4397d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.476955:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4397d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.477126:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.477135:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.477141:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.477256:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 3/0,1 mode: --/EX res: [0x200000401:0x258:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.477265:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.477271:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.477634:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653394560 00000100:00100000:3.0:1776187966.477682:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4416 00000100:00100000:3.0:1776187966.477688:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+511:11304:x1862467653394560:12345-192.168.204.20@tcp:37:dbench.0 00000040:00080000:0.0:1776187966.479592:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].408, 64 off34368 00000040:00080000:0.0:1776187966.479624:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4691, 184 off825064 00010000:00010000:0.0:1776187966.479727:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x258:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479751:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479764:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479779:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479786:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479793:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479829:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.479855:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000066f354e3 reply state 00000000601cbc32 transno 4294974999 ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x258:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479911:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.479915:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479922:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.479925:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479933:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479946:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x258:0x0].0x0 (00000000219adb48) 00010000:00010000:0.0:1776187966.479949:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.479953:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.479958:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x258:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.485496:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4397d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.485527:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4397d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.485535:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4397d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.485542:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.485547:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4397d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.485555:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4397d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.485579:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:1.0:1776187966.485582:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.485588:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4397d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.485594:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee4397d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.485607:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000066f354e3 reply state 00000000601cbc32 transno 4294974999 ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.485786:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066f354e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+514:11303:x1862467653394496:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 9073us (10840us total) trans 4294974999 rc 0/0 00000100:00100000:1.0:1776187966.485801:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15293 00010000:00010000:0.0:1776187966.486818:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.486822:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.486824:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187966.490798:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.490908:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653394688 00000100:00100000:0.0:1776187966.490961:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4417 00000100:00100000:0.0:1776187966.490969:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c6fe787 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+514:11303:x1862467653394688:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.491219:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c6fe787 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+515:11303:x1862467653394688:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 250us (433us total) trans 4294975000 rc 0/0 00000100:00100000:0.0:1776187966.491228:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4417 00010000:00010000:2.0:1776187966.491302:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491316:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491323:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491330:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007072c805 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.491333:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491341:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491358:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x51a4c572 (00000000693f1349) 00010000:00010000:2.0:1776187966.491361:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.491365:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491371:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee4397d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x51a4c572 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491387:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491394:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491399:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491405:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b23405f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.491406:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491411:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491418:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x258:0x0].0x0 (00000000219adb48) 00010000:00010000:2.0:1776187966.491420:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187966.491422:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 2/0,0 mode: --/EX res: [0x200000401:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.491427:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee4397df lrc: 0/0,0 mode: --/EX res: [0x200000401:0x258:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.493212:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+512:11304:x1862467653394560:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 15176us (16529us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.493229:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4416 00000100:00100000:1.0:1776187966.501286:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.501406:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653394816 00000100:00100000:0.0:1776187966.501469:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15294 00000100:00100000:0.0:1776187966.501476:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bd4f7d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+512:11303:x1862467653394816:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.501549:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187966.501577:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4c4af76/0x92b1eb87ee42b102 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c654a expref: 512 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501605:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005480131e/0x92b1eb87ee426632 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4a4d expref: 511 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501619:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a5aed31/0x92b1eb87ee426671 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4a69 expref: 510 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501635:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000016ccaec2/0x92b1eb87ee41ff7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2803 expref: 509 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501644:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25e:0x0].0x0 (0000000023b6c342) 00010000:00010000:0.0:1776187966.501654:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.501694:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501709:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501719:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501733:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501740:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501746:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501857:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.501866:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502026:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187966.502415:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].409, 64 off34432 00000040:00080000:0.0:1776187966.502438:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4692, 184 off825248 00010000:00010000:0.0:1776187966.502501:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502512:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502520:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502527:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502533:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502539:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502821:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.502843:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000003bd4f7d8 reply state 00000000d0190be5 transno 4294975001 ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502914:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502925:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502931:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502936:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.502941:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502948:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502960:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:0.0:1776187966.502963:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.502967:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.502973:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee4397ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.502982:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000003bd4f7d8 reply state 00000000d0190be5 transno 4294975001 ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.503108:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bd4f7d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+510:11303:x1862467653394816:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1629us (1828us total) trans 4294975001 rc 0/0 00000100:00100000:0.0:1776187966.503118:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15294 00000100:00100000:3.0:1776187966.505517:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.505624:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653394944 00000100:00100000:1.0:1776187966.505679:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4418 00000100:00100000:1.0:1776187966.505686:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007579bd7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+510:11304:x1862467653394944:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.505935:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007579bd7f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+511:11304:x1862467653394944:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 249us (426us total) trans 4294975002 rc 0/0 00000100:00100000:1.0:1776187966.505943:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4418 00010000:00010000:0.0:1776187966.506195:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506215:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506223:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506229:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.506233:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506239:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506253:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x9e362f1b (000000007f00126a) 00010000:00010000:0.0:1776187966.506257:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.506260:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506266:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee4397f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x9e362f1b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506285:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506290:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506295:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506306:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005f47f5e7 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.506307:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506312:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506318:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25e:0x0].0x0 (000000000f4996f9) 00010000:00010000:0.0:1776187966.506320:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.506321:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.506326:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee4397fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x25e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.507302:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.507312:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.507325:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a9283777 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.507329:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.508366:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.508390:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25e:0x0].0x0 (000000000f4996f9) 00010000:00010000:2.0:1776187966.508393:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.508408:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.508414:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439802 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.508439:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.508440:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.508442:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187966.510529:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.510635:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653395072 00000100:00100000:1.0:1776187966.510699:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4419 00000100:00100000:1.0:1776187966.510707:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b166f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+510:11303:x1862467653395072:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.511023:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b166f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+511:11303:x1862467653395072:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 315us (503us total) trans 4294975003 rc 0/0 00000100:00100000:1.0:1776187966.511032:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4419 00000100:00100000:1.0:1776187966.515008:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.515248:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653395200 00000100:00100000:3.0:1776187966.515318:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15295 00000100:00100000:3.0:1776187966.515325:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c0f5dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+511:11304:x1862467653395200:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.515421:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1776187966.515457:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f83acf44/0x92b1eb87ee433721 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c90f5 expref: 511 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515483:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000002c41f17/0x92b1eb87ee424642 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23d:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3ff0 expref: 510 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515497:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b67ced5c/0x92b1eb87ee4246dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23d:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4028 expref: 509 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515508:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000008db4c2c/0x92b1eb87ee41f296 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23d:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22ae expref: 508 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515520:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23d:0x0].0x0 (000000003d351470) 00010000:00010000:3.0:1776187966.515540:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee4390d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa71 expref: 507 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515548:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0x0 (00000000e23ff234) 00010000:00010000:3.0:1776187966.515551:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.515588:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439809 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515606:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439809 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515617:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439809 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515637:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515645:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515651:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515814:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515822:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.515829:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187966.516317:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].410, 64 off34496 00000040:00080000:3.0:1776187966.516338:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4693, 176 off825424 00010000:00010000:3.0:1776187966.516398:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.516408:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.516416:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.516423:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.516429:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.516434:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.516454:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187966.516473:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002c0f5dbd reply state 00000000d8bc8750 transno 4294975004 ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.517107:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187966.517114:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.517124:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000052d92773 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187966.517128:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.517135:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.517151:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23d:0x0].0x0 (000000004e9c3dd8) 00010000:00010000:1.0:1776187966.517154:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187966.517157:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.517162:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43981e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.517178:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.517179:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.517181:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.519586:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439809 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.519609:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439809 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.519617:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439809 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.519623:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035ee1513 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.519628:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439809 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.519636:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439809 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.519658:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0x0 (00000000e23ff234) 00010000:00010000:3.0:1776187966.519660:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.519671:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439809 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.519677:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439809 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187966.519694:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002c0f5dbd reply state 00000000d8bc8750 transno 4294975004 ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.519814:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c0f5dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+508:11304:x1862467653395200:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 4486us (4814us total) trans 4294975004 rc 0/0 00000100:00100000:3.0:1776187966.519825:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15295 00000100:00100000:2.0:1776187966.520068:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.520455:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653395328 00000100:00100000:1.0:1776187966.520499:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15296 00000100:00100000:1.0:1776187966.520505:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5ef1e90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+508:11303:x1862467653395328:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.520562:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.520588:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bd880ae6/0x92b1eb87ee42b0bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c652e expref: 508 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520609:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000024093fa4/0x92b1eb87ee4261b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4904 expref: 507 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520620:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d0a6e9cb/0x92b1eb87ee426226 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4920 expref: 506 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520632:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008a064986/0x92b1eb87ee41fdfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2762 expref: 505 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520644:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25a:0x0].0x0 (00000000d6a2ed12) 00010000:00010000:1.0:1776187966.520660:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.520694:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439825 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520710:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439825 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520719:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439825 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520731:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520737:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520743:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520847:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520854:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.520860:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.521391:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].410, 64 off34496 00000040:00080000:1.0:1776187966.521417:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4694, 184 off825608 00010000:00010000:1.0:1776187966.523695:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.523737:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.523753:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.523763:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.523770:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.523777:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.523850:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.523904:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f5ef1e90 reply state 000000002a9075f0 transno 4294975005 ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.523993:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439825 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.524000:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439825 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.524008:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439825 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.524014:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.524018:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439825 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.524024:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439825 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.524038:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:1.0:1776187966.524041:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.524046:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439825 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.524053:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439825 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.524065:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f5ef1e90 reply state 000000002a9075f0 transno 4294975005 ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.524164:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5ef1e90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+506:11303:x1862467653395328:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3654us (4094us total) trans 4294975005 rc 0/0 00000100:00100000:1.0:1776187966.524173:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15296 00000100:00100000:2.0:1776187966.528237:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.528375:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653395456 00000100:00100000:3.0:1776187966.528438:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4420 00000100:00100000:3.0:1776187966.528445:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d19b542 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+506:11304:x1862467653395456:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187966.528729:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d19b542 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+507:11304:x1862467653395456:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 282us (499us total) trans 4294975006 rc 0/0 00000100:00100000:3.0:1776187966.528737:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4420 00010000:00010000:1.0:1776187966.529653:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529677:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529685:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529691:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c2e5f2ee already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.529695:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529702:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529719:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0x14be06ab (00000000a528b82c) 00010000:00010000:1.0:1776187966.529722:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.529726:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529733:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee439810 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23c:0x0].0x14be06ab bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529752:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529756:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529761:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529766:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ba32a0cd already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.529768:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529774:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529781:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23d:0x0].0x0 (000000004e9c3dd8) 00010000:00010000:1.0:1776187966.529783:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.529785:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.529790:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee439817 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x23d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.530323:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.530443:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653395584 00000100:00100000:1.0:1776187966.530488:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4421 00000100:00100000:1.0:1776187966.530494:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+506:11303:x1862467653395584:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.530760:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+507:11303:x1862467653395584:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 265us (441us total) trans 4294975007 rc 0/0 00000100:00100000:1.0:1776187966.530768:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4421 00010000:00010000:3.0:1776187966.531294:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531306:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531313:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531320:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.531323:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531331:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531357:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x6324417e (00000000f54f0a62) 00010000:00010000:3.0:1776187966.531360:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.531364:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531369:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43982c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x6324417e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531387:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531397:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531401:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531406:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c48750ea already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.531408:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531413:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531419:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25a:0x0].0x0 (000000007842f307) 00010000:00010000:3.0:1776187966.531421:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.531423:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.531427:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439833 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x25a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.533451:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.533467:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.533485:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d26d87db already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.533490:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.533502:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.533525:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25a:0x0].0x0 (000000007842f307) 00010000:00010000:0.0:1776187966.533528:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.533534:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.533539:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43983a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.533571:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.533572:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.533574:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.534394:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.534480:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653395712 00000100:00100000:1.0:1776187966.534534:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15297 00000100:00100000:1.0:1776187966.534540:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082814a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+506:11304:x1862467653395712:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.534597:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.534619:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4357b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x242:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9a25 expref: 506 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534638:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f903702c/0x92b1eb87ee424acc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x242:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c417f expref: 505 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534656:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001ddca12f/0x92b1eb87ee424b27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x242:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c41a2 expref: 504 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534681:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b1616188/0x92b1eb87ee41f479 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x242:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c236b expref: 503 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534695:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x242:0x0].0x0 (00000000b738f150) 00010000:00010000:1.0:1776187966.534702:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.534732:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439841 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534748:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439841 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534759:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439841 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534776:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534782:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534788:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534932:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x242:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534945:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.534952:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.535328:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].411, 64 off34560 00000040:00080000:1.0:1776187966.535351:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4695, 184 off825792 00010000:00010000:1.0:1776187966.535421:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x242:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535432:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535440:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535449:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535457:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535463:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535487:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.535514:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000082814a1e reply state 000000001c181815 transno 4294975008 ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x242:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535578:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439841 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535585:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439841 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535591:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439841 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535597:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.535600:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439841 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535606:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439841 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535615:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0x0 (00000000e23ff234) 00010000:00010000:1.0:1776187966.535618:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.535621:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439841 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.535627:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439841 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.535636:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000082814a1e reply state 000000001c181815 transno 4294975008 ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.535734:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082814a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+504:11304:x1862467653395712:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1192us (1346us total) trans 4294975008 rc 0/0 00000100:00100000:1.0:1776187966.535744:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15297 00010000:00010000:3.0:1776187966.536375:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.536382:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.536392:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d719b35a already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.536395:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.536408:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.536420:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x242:0x0].0x0 (000000006c0357c0) 00010000:00010000:3.0:1776187966.536422:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.536424:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.536430:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439856 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x242:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.536442:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.536443:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.536444:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.545404:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.545526:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.545822:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653395968 00000100:00100000:3.0:1776187966.545925:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4422 00000100:00100000:3.0:1776187966.545933:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037c823f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+504:11304:x1862467653395968:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.546152:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653395840 00000100:00100000:0.0:1776187966.546184:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15298 00000100:00100000:0.0:1776187966.546188:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b8d2943 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+506:11303:x1862467653395840:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.546226:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00000100:00100000:3.0:1776187966.546228:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037c823f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+506:11304:x1862467653395968:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 295us (702us total) trans 4294975009 rc 0/0 00000100:00100000:3.0:1776187966.546235:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4422 00010000:00010000:0.0:1776187966.546256:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000096e535ae/0x92b1eb87ee42b275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c65dd expref: 505 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546276:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d53ee93/0x92b1eb87ee4263a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4990 expref: 504 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546290:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8fa58c2/0x92b1eb87ee42641e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c49b3 expref: 503 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546302:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fa91afdb/0x92b1eb87ee41feb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27a8 expref: 502 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546311:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25c:0x0].0x0 (000000002ac2be17) 00010000:00010000:0.0:1776187966.546319:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.546434:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43985d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546456:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43985d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546466:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43985d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546479:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546486:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546492:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546584:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546592:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.546599:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547534:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547548:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547554:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547559:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.547564:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547572:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547585:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0xc4fc354d (00000000194664fe) 00010000:00010000:1.0:1776187966.547588:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.547591:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547596:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439848 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23c:0x0].0xc4fc354d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547611:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547616:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547622:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547627:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cea3a6c8 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.547629:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547634:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547641:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x242:0x0].0x0 (000000006c0357c0) 00010000:00010000:1.0:1776187966.547642:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.547644:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.547649:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43984f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x242:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.548285:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].412, 64 off34624 00000040:00080000:2.0:1776187966.548306:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4696, 184 off825976 00010000:00010000:2.0:1776187966.548379:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548394:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548405:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548412:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548418:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548423:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548445:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.548462:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008b8d2943 reply state 00000000208e31ad transno 4294975010 ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548508:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43985d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548514:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43985d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548519:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43985d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548524:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005f47f5e7 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.548527:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43985d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548532:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43985d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548542:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:2.0:1776187966.548544:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.548546:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43985d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.548551:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43985d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.548558:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008b8d2943 reply state 00000000208e31ad transno 4294975010 ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.548644:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b8d2943 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+502:11303:x1862467653395840:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2452us (3248us total) trans 4294975010 rc 0/0 00000100:00100000:2.0:1776187966.548653:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15298 00010000:00010000:1.0:1776187966.551125:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187966.551137:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.551151:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009d004fc already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187966.551155:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.551165:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.551196:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25c:0x0].0x0 (000000004c664cf8) 00010000:00010000:1.0:1776187966.551208:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187966.551212:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.551219:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439872 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.551238:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.551240:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.551241:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.553361:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553381:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553388:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553395:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.553399:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553406:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553424:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x76821429 (000000007f00126a) 00010000:00010000:3.0:1776187966.553427:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.553430:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553436:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439864 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x76821429 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553454:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553460:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553465:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553470:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.553471:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553476:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553483:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25c:0x0].0x0 (000000004c664cf8) 00010000:00010000:3.0:1776187966.553485:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.553486:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.553491:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee43986b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x25c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.557831:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.558270:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653396096 00000100:00100000:0.0:1776187966.558335:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15299 00000100:00100000:0.0:1776187966.558343:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7220d98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+501:11304:x1862467653396096:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.558410:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187966.558444:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee4354a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c997d expref: 501 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558469:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000038c6328c/0x92b1eb87ee424809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c408a expref: 500 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558482:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000021c5b72b/0x92b1eb87ee4248b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c40c2 expref: 499 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558493:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000076f49735/0x92b1eb87ee41f392 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2310 expref: 498 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558503:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23f:0x0].0x0 (00000000856df8b8) 00010000:00010000:0.0:1776187966.558514:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.558547:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439879 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558563:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439879 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558572:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439879 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558585:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558592:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558597:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558705:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558713:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.558719:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187966.559132:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].411, 64 off34560 00000040:00080000:0.0:1776187966.559158:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4697, 184 off826160 00010000:00010000:0.0:1776187966.559227:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559238:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559245:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559253:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559259:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559265:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559289:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.559307:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f7220d98 reply state 00000000e7ce3491 transno 4294975011 ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559353:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439879 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559359:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439879 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559364:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439879 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559369:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.559372:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439879 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559378:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439879 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559386:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0x0 (00000000e23ff234) 00010000:00010000:0.0:1776187966.559389:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.559392:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439879 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.559397:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439879 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x23c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.559406:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000f7220d98 reply state 00000000e7ce3491 transno 4294975011 ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.559484:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7220d98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+499:11304:x1862467653396096:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1140us (1665us total) trans 4294975011 rc 0/0 00000100:00100000:0.0:1776187966.559492:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15299 00000100:00100000:2.0:1776187966.559723:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.559769:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653396224 00000100:00100000:2.0:1776187966.559800:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4423 00000100:00100000:2.0:1776187966.559805:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000643fa20e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+499:11303:x1862467653396224:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.559974:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000643fa20e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+500:11303:x1862467653396224:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 167us (252us total) trans 4294975012 rc 0/0 00000100:00100000:2.0:1776187966.559981:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4423 00010000:00010000:3.0:1776187966.560592:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.560599:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.560610:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089ca4280 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.560613:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.560620:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.560635:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23f:0x0].0x0 (00000000a7c2e43a) 00010000:00010000:3.0:1776187966.560637:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.560641:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.560646:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43988e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.560658:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.560661:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.560662:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.569462:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1776187966.569554:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569571:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569578:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569584:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000095ae11d5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.569589:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569597:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569612:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0x77103a66 (00000000298f4138) 00010000:00010000:1.0:1776187966.569615:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.569620:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569626:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee439880 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x23c:0x0].0x77103a66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569646:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569651:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569657:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569662:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059094af5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.569664:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569682:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569690:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23f:0x0].0x0 (00000000a7c2e43a) 00010000:00010000:1.0:1776187966.569692:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.569694:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.569699:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439887 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x23f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.578024:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653396288 00000100:00100000:1.0:1776187966.579146:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4424 00000100:00100000:1.0:1776187966.579156:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfe64d29 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+499:11304:x1862467653396288:12345-192.168.204.20@tcp:37:dbench.0 00000100:00100000:3.0:1776187966.579623:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.583262:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653396416 00000100:00100000:1.0:1776187966.583452:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15300 00000100:00100000:1.0:1776187966.583460:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cab47b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+501:11303:x1862467653396416:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.583519:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.583547:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b822dc87/0x92b1eb87ee42a333 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c6026 expref: 501 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583569:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000db36b256/0x92b1eb87ee4251b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c43bd expref: 500 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583579:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c12e8054/0x92b1eb87ee425219 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24a:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c43d9 expref: 499 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583590:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003c1465bf/0x92b1eb87ee41f7dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24c2 expref: 498 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583598:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24a:0x0].0x0 (00000000cb17d56e) 00010000:00010000:1.0:1776187966.583608:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.583645:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439895 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583661:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439895 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583680:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439895 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583696:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583703:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583710:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583822:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583830:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.583836:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.586078:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].413, 64 off34688 00000040:00080000:1.0:1776187966.586103:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4698, 184 off826344 00010000:00010000:1.0:1776187966.586180:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586211:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586222:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586230:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586241:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586247:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586262:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1776187966.586280:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00010000:1.0:1776187966.586283:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007cab47b6 reply state 000000006541db9d transno 4294975013 ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.586285:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.586293:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000474fd8b4 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.586296:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.586303:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.586317:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24a:0x0].0x0 (00000000194664fe) 00010000:00010000:3.0:1776187966.586319:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.586323:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.586328:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586332:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439895 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586338:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439895 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586343:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439895 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586348:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cea3a6c8 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.586351:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439895 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586356:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439895 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586362:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:1.0:1776187966.586364:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.586367:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439895 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.586372:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439895 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.586379:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007cab47b6 reply state 000000006541db9d transno 4294975013 ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.586424:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.586425:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.586427:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187966.586464:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cab47b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+499:11303:x1862467653396416:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3001us (6840us total) trans 4294975013 rc 0/0 00000100:00100000:1.0:1776187966.586475:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15300 00000100:00100000:2.0:1776187966.587254:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfe64d29 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+497:11304:x1862467653396288:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 8094us (17796us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.587266:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4424 00010000:00010000:3.0:1776187966.591332:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591363:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591371:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591378:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.591383:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591389:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591405:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0xca0b3ea (000000006c0357c0) 00010000:00010000:3.0:1776187966.591408:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.591412:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591418:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43989c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xca0b3ea bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591439:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591446:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591452:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591457:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.591459:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591465:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591472:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24a:0x0].0x0 (00000000194664fe) 00010000:00010000:3.0:1776187966.591475:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.591476:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.591481:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee4398a3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.592594:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.593069:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653396544 00000100:00100000:2.0:1776187966.593123:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4425 00000100:00100000:2.0:1776187966.593130:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000140b6540 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+496:11303:x1862467653396544:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.593379:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000140b6540 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+497:11303:x1862467653396544:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 248us (791us total) trans 4294975014 rc 0/0 00000100:00100000:2.0:1776187966.593387:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4425 00000100:00100000:2.0:1776187966.596174:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.596264:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653396672 00000100:00100000:1.0:1776187966.596318:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15301 00000100:00100000:1.0:1776187966.596324:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d19b542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+497:11303:x1862467653396672:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.596375:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.596400:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000085ca5851/0x92b1eb87ee42aff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x254:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c64e1 expref: 497 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596421:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aedcadc1/0x92b1eb87ee425bb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x254:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c471a expref: 496 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596432:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000889616e4/0x92b1eb87ee425bf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x254:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c472f expref: 495 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596441:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005a0d0775/0x92b1eb87ee41fbd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x254:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2674 expref: 494 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596451:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x254:0x0].0x0 (000000001ab882ff) 00010000:00010000:1.0:1776187966.596460:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.596488:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4398b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596501:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4398b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596509:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4398b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596521:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596528:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596533:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596620:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x254:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596626:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.596632:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.596979:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].414, 64 off34752 00000040:00080000:1.0:1776187966.597000:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4699, 184 off826528 00010000:00010000:1.0:1776187966.597057:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x254:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.597066:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.597073:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.597080:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.597086:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.597091:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.598384:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.598417:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008d19b542 reply state 000000000f83275e transno 4294975015 ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x254:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.598479:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4398b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.598486:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4398b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.598492:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4398b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.598497:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.598501:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4398b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.598509:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4398b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.598523:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:1.0:1776187966.598525:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.598529:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4398b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.598534:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee4398b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.598545:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008d19b542 reply state 000000000f83275e transno 4294975015 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.598688:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d19b542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+495:11303:x1862467653396672:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2360us (2519us total) trans 4294975015 rc 0/0 00000100:00100000:1.0:1776187966.598697:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15301 00010000:00010000:3.0:1776187966.598817:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.598822:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.598829:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d719b35a already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.598831:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.598838:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.598846:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x254:0x0].0x0 (00000000e5f011d9) 00010000:00010000:3.0:1776187966.598848:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.598850:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.598856:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee4398c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x254:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.598867:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.598868:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.598870:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.602623:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.603275:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653396736 00000100:00100000:2.0:1776187966.603342:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15302 00000100:00100000:2.0:1776187966.603351:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078ed3625 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+495:11304:x1862467653396736:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:2.0:1776187966.603378:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187966.603402:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4398cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caaa9 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603467:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4398d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603483:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4398d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603495:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4398d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603512:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4398db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603517:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4398db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603523:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4398db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603627:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee4398e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603636:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee4398e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603643:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee4398e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187966.603691:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20c:0x0]: returning size 260096 00000004:00200000:2.0:1776187966.603697:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187966.603716:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee4398e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20c:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603727:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee4398e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603734:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4398d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603741:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4398d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603747:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4398d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603753:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d81ab485 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.603756:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4398d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603763:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4398d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603776:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x0 (00000000be4d8ce3) 00010000:00010000:2.0:1776187966.603778:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.603783:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4398d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603788:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee4398d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603800:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4398db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603804:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4398db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603809:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4398db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603812:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092776876 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.603814:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4398db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603818:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4398db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603824:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0xf786fdb3 (0000000021698773) 00010000:00010000:2.0:1776187966.603826:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.603827:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4398db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603832:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee4398db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603858:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4398cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa9 expref: 497 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.603869:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee4398e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa9 expref: 496 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604164:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604172:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604177:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604181:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4841773 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.604184:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604190:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604212:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x103f9c81 (000000008d2350fb) 00010000:00010000:1.0:1776187966.604215:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.604217:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604221:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee4398b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x103f9c81 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604235:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604240:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604245:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604250:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000474fd8b4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.604252:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604258:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604265:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x254:0x0].0x0 (00000000e5f011d9) 00010000:00010000:1.0:1776187966.604267:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.604269:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.604274:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee4398bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x254:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.604350:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20c:0x0].0x0 (0000000078f90596) 00010000:00010000:2.0:1776187966.604353:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1776187966.604355:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f8111509, rc 0) 00000100:00100000:2.0:1776187966.604428:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078ed3625 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+495:11304:x1862467653396736:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 1076us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.604436:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15302 00000100:00100000:2.0:1776187966.605140:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.605311:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653396864 00000100:00100000:1.0:1776187966.605356:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4426 00000100:00100000:1.0:1776187966.605428:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+495:11303:x1862467653396864:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.605786:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+496:11303:x1862467653396864:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 359us (649us total) trans 4294975016 rc 0/0 00000100:00100000:1.0:1776187966.605795:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4426 00000100:00100000:1.0:1776187966.608847:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.609219:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.609255:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.609276:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653397056 00000100:00100000:3.0:1776187966.609347:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653396928 00000100:00100000:3.0:1776187966.609385:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653397184 00000100:00100000:3.0:1776187966.609415:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15303 00000100:00100000:3.0:1776187966.609423:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c6fe787 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+498:2224:x1862467653396928:12345-192.168.204.20@tcp:101:ll_sa_11304.0 00010000:00010000:3.0:1776187966.609451:0:5515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187966.609472:0:5515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4398e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caab0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609529:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee4398f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609542:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee4398f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609552:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee4398f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609563:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee4398f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609569:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee4398f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609574:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee4398f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609681:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee4398fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609689:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee4398fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609695:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee4398fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187966.609726:0:5515:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20e:0x0]: returning size 260096 00000004:00200000:3.0:1776187966.609730:0:5515:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187966.609751:0:5515:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee4398fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20e:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609763:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee4398fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609773:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee4398f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609779:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee4398f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609784:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee4398f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609791:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000503e410b already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.609794:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee4398f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609805:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee4398f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609815:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x0 (00000000be4d8ce3) 00010000:00010000:3.0:1776187966.609817:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.609820:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee4398f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609825:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee4398f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609837:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee4398f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609842:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee4398f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609847:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee4398f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609851:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000900c220d already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.609852:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee4398f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609856:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee4398f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609861:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x204a7f30 (00000000866a3643) 00010000:00010000:3.0:1776187966.609863:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.609865:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee4398f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609869:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee4398f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609915:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee4398e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab0 expref: 500 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609927:0:5515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee4398fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab0 expref: 499 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.609933:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20e:0x0].0x0 (00000000407ae31f) 00010000:00010000:3.0:1776187966.609936:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1776187966.609937:0:5515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b9973b27, rc 0) 00000100:00100000:3.0:1776187966.610005:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c6fe787 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+499:2224:x1862467653396928:12345-192.168.204.20@tcp:101:ll_sa_11304.0 Request processed in 580us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.610012:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15303 00000100:00100000:3.0:1776187966.610030:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15304 00000100:00100000:3.0:1776187966.610033:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbe52803 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+498:11303:x1862467653397184:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.610079:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.610097:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ff6aac4a/0x92b1eb87ee42a2ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x245:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5ff5 expref: 498 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610112:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000dd4f496/0x92b1eb87ee424d34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x245:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4235 expref: 497 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610125:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce08357a/0x92b1eb87ee424d88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x245:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c424a expref: 496 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610135:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000062fe8030/0x92b1eb87ee41f5de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x245:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c23f0 expref: 495 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610143:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x245:0x0].0x0 (000000003d300d8f) 00010000:00010000:3.0:1776187966.610148:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.610166:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439905 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610174:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610181:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610190:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610196:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610214:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610266:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x245:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610272:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.610280:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187966.610625:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].412, 64 off34624 00000040:00080000:3.0:1776187966.610648:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4700, 184 off826712 00000100:00100000:1.0:1776187966.611132:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4427 00000100:00100000:1.0:1776187966.611140:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+495:11304:x1862467653397056:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.611600:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+496:11304:x1862467653397056:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 459us (2380us total) trans 4294975018 rc 0/0 00000100:00100000:1.0:1776187966.611608:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4427 00010000:00010000:0.0:1776187966.612123:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x245:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612141:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612152:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612160:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612167:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612173:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612196:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.612219:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000dbe52803 reply state 00000000ee5776b9 transno 4294975017 ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x245:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612270:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439905 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612276:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439905 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612281:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439905 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612286:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000752cecf8 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.612289:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439905 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612295:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439905 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612308:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:0.0:1776187966.612310:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.612314:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439905 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.612319:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee439905 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.612329:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000dbe52803 reply state 00000000ee5776b9 transno 4294975017 ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.612346:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.612350:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.612357:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.612359:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.612373:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.612382:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x245:0x0].0x0 (000000004e9c3dd8) 00010000:00010000:3.0:1776187966.612384:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.612386:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.612391:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43991a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x245:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.612401:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.612402:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.612403:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.612481:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbe52803 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+496:11303:x1862467653397184:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2445us (3225us total) trans 4294975017 rc 0/0 00000100:00100000:0.0:1776187966.612492:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15304 00000100:00100000:2.0:1776187966.614818:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.614936:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653397312 00000100:00100000:0.0:1776187966.614983:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15305 00000100:00100000:0.0:1776187966.614990:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037c823f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+496:11304:x1862467653397312:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.615045:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1776187966.615071:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee4398e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaa9 expref: 496 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615093:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee4221c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3419 expref: 495 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615104:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000bea52448/0x92b1eb87ee4221eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3427 expref: 494 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615114:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000061fa5721/0x92b1eb87ee41de6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a9d expref: 493 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615123:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20c:0x0].0x0 (0000000078f90596) 00010000:00010000:0.0:1776187966.615136:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43912c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x209:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa78 expref: 492 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615142:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x0 (00000000be4d8ce3) 00010000:00010000:0.0:1776187966.615145:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.615172:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439921 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x209:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615186:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615195:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615220:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615227:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615233:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615344:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615352:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615358:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187966.615762:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].415, 64 off34816 00000040:00080000:0.0:1776187966.615787:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4701, 184 off826896 00010000:00010000:0.0:1776187966.615849:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615859:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615869:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615907:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615913:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615919:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.615940:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.615957:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000037c823f6 reply state 0000000085f4762e transno 4294975019 ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.616006:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439921 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.616011:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439921 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.616017:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439921 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.616023:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000af78cd92 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.616027:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439921 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.616033:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439921 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.616048:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x0 (00000000be4d8ce3) 00010000:00010000:0.0:1776187966.616051:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.616053:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439921 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.616058:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee439921 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.616067:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000037c823f6 reply state 0000000085f4762e transno 4294975019 ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.616150:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037c823f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+493:11304:x1862467653397312:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1158us (1338us total) trans 4294975019 rc 0/0 00000100:00100000:0.0:1776187966.616158:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15305 00010000:00010000:2.0:1776187966.616375:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.616380:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.616388:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000059fd37 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.616391:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.616397:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.616406:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20c:0x0].0x0 (0000000014211482) 00010000:00010000:2.0:1776187966.616409:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.616411:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.616416:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439936 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.616426:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.616427:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.616429:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.621031:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621056:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621065:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621072:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000019adf367 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.621076:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621084:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621104:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0xcd7d97c8 (000000006882895f) 00010000:00010000:3.0:1776187966.621107:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.621112:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621117:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee43990c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xcd7d97c8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621141:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621147:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621152:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621162:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.621164:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621169:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621176:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x245:0x0].0x0 (000000004e9c3dd8) 00010000:00010000:3.0:1776187966.621178:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.621180:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.621185:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439913 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x245:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.621421:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187966.621533:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.621542:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.621546:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.621549:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653397440 00010000:00010000:0.0:1776187966.621551:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a152635 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.621553:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.621557:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.621566:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0xf786fdb3 (000000003dd9608e) 00010000:00010000:0.0:1776187966.621568:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.621570:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.621574:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439928 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x209:0x0].0xf786fdb3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.621587:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.621593:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.621597:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.621602:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4428 00010000:00010000:0.0:1776187966.621602:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000862e8a84 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.621604:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.621608:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000168460a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+492:11303:x1862467653397440:12345-192.168.204.20@tcp:35:dbench.0 00010000:00010000:0.0:1776187966.621609:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.621616:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20c:0x0].0x0 (0000000014211482) 00010000:00010000:0.0:1776187966.621618:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.621619:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.621627:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee43992f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.621849:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000168460a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+492:11303:x1862467653397440:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 239us (431us total) trans 4294975020 rc 0/0 00000100:00100000:2.0:1776187966.621857:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4428 00000100:00100000:0.0:1776187966.622704:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.622768:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653397568 00000100:00100000:2.0:1776187966.622806:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4429 00000100:00100000:2.0:1776187966.622811:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+492:11304:x1862467653397568:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.623072:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+493:11304:x1862467653397568:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 259us (371us total) trans 4294975021 rc 0/0 00000100:00100000:2.0:1776187966.623079:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4429 00000100:00100000:0.0:1776187966.624595:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.624683:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653397696 00000100:00100000:1.0:1776187966.624733:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15306 00000100:00100000:1.0:1776187966.624738:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c4d5713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+493:11303:x1862467653397696:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.624795:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.624822:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f59e519e/0x92b1eb87ee4272cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4e9f expref: 493 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.624846:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087875c28/0x92b1eb87ee4204b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a41 expref: 492 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.624858:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009da5d264/0x92b1eb87ee427305 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4eb4 expref: 491 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.624869:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000caa71309/0x92b1eb87ee4204a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26b:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a3a expref: 490 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.624916:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26b:0x0].0x0 (0000000067493e54) 00010000:00010000:1.0:1776187966.624926:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.624959:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43993d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.624974:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43993d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.624984:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43993d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.624999:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625006:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625013:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625116:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625124:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625130:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.625478:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].413, 64 off34688 00000040:00080000:1.0:1776187966.625499:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4702, 184 off827080 00010000:00010000:1.0:1776187966.625555:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625564:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625572:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625579:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625584:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625590:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625614:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.625632:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004c4d5713 reply state 00000000080d527e transno 4294975022 ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625678:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43993d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625684:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43993d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625690:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43993d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625696:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000474fd8b4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.625699:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43993d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625705:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43993d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625713:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:1.0:1776187966.625716:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.625718:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43993d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.625723:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43993d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.625732:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004c4d5713 reply state 00000000080d527e transno 4294975022 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.625816:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c4d5713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+491:11303:x1862467653397696:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1075us (1225us total) trans 4294975022 rc 0/0 00000100:00100000:1.0:1776187966.625825:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15306 00010000:00010000:3.0:1776187966.626116:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.626122:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.626129:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cea3a6c8 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.626132:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.626137:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.626146:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26b:0x0].0x0 (000000008d2350fb) 00010000:00010000:3.0:1776187966.626148:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.626151:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.626156:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439952 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.626167:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.626169:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.626170:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187966.626861:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.627046:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653397824 00000100:00100000:2.0:1776187966.627125:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15307 00000100:00100000:2.0:1776187966.627132:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e4613a69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+491:11304:x1862467653397824:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.627173:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.627190:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee4398fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab0 expref: 491 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627215:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000097fbb242/0x92b1eb87ee422270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3451 expref: 490 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627224:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f137b746/0x92b1eb87ee422293 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20e:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c345f expref: 489 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627231:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a9acfb41/0x92b1eb87ee41df79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b06 expref: 488 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627237:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20e:0x0].0x0 (00000000407ae31f) 00010000:00010000:2.0:1776187966.627242:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.627263:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439959 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x209:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627272:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439959 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627277:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439959 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627286:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627290:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627293:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627372:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627378:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627383:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.627670:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].416, 64 off34880 00000040:00080000:2.0:1776187966.627686:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4703, 184 off827264 00010000:00010000:2.0:1776187966.627744:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627753:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627760:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627771:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627777:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627782:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627806:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.627822:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e4613a69 reply state 000000008f1cec76 transno 4294975023 ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627864:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439959 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627870:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439959 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627909:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439959 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627915:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aea18492 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.627918:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439959 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627923:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439959 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627935:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x0 (00000000be4d8ce3) 00010000:00010000:2.0:1776187966.627937:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.627940:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439959 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.627944:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439959 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x209:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.627951:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e4613a69 reply state 000000008f1cec76 transno 4294975023 ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.628027:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e4613a69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+489:11304:x1862467653397824:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 893us (1169us total) trans 4294975023 rc 0/0 00000100:00100000:2.0:1776187966.628035:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15307 00010000:00010000:3.0:1776187966.628102:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.628106:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.628113:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089fb6120 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.628115:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.628120:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.628129:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20e:0x0].0x0 (0000000063901265) 00010000:00010000:3.0:1776187966.628131:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.628133:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.628138:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43996e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x20e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.628147:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.628148:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.628150:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.629736:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629749:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629754:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629757:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4841773 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.629760:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629764:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629774:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x21e72734 (00000000e5f011d9) 00010000:00010000:2.0:1776187966.629776:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.629779:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629783:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439944 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x21e72734 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629795:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629798:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629801:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629804:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.629805:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629808:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629812:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26b:0x0].0x0 (000000008d2350fb) 00010000:00010000:2.0:1776187966.629813:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187966.629814:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.629820:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43994b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x26b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631572:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631592:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631606:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631612:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092776876 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.631616:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631623:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631638:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x204a7f30 (0000000021698773) 00010000:00010000:0.0:1776187966.631640:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.631644:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631649:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439960 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x209:0x0].0x204a7f30 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631677:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631682:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631687:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631691:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d81ab485 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.631692:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631696:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631701:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20e:0x0].0x0 (0000000063901265) 00010000:00010000:0.0:1776187966.631702:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.631704:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.631708:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439967 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.633084:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.633253:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653397952 00000100:00100000:2.0:1776187966.633351:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4430 00000100:00100000:2.0:1776187966.633358:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c89e96e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+487:11303:x1862467653397952:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.633682:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c89e96e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+488:11303:x1862467653397952:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 323us (608us total) trans 4294975024 rc 0/0 00000100:00100000:2.0:1776187966.633691:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4430 00000100:00100000:1.0:1776187966.634519:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.634555:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653398016 00000100:00100000:2.0:1776187966.634593:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4431 00000100:00100000:2.0:1776187966.634598:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f9a96ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+488:11304:x1862467653398016:12345-192.168.204.20@tcp:37:dbench.0 00000100:00100000:0.0:1776187966.639893:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.640549:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f9a96ac pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+488:11304:x1862467653398016:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 5947us (6029us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.640573:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4431 00000100:00100000:1.0:1776187966.642678:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653398144 00000100:00100000:1.0:1776187966.643915:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15308 00000100:00100000:1.0:1776187966.643925:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f4c75a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+488:11303:x1862467653398144:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.643990:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.644019:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000500180b8/0x92b1eb87ee42b15d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c656d expref: 488 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644044:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e100b95c/0x92b1eb87ee426719 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4a93 expref: 487 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644057:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f1ab326/0x92b1eb87ee426766 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4aa8 expref: 486 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644070:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c75d0d0f/0x92b1eb87ee42000a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25f:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2842 expref: 485 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644080:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25f:0x0].0x0 (00000000e891e21b) 00010000:00010000:1.0:1776187966.644090:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.644124:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439975 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644145:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644284:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644302:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644309:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644316:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644424:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644433:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.644439:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.645869:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].414, 64 off34752 00000040:00080000:1.0:1776187966.646005:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4705, 184 off827576 00010000:00010000:1.0:1776187966.646080:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646095:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646106:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646114:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646120:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646126:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646257:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.646280:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008f4c75a3 reply state 00000000853d54dc transno 4294975025 ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646331:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439975 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646337:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439975 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646343:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439975 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646349:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000474fd8b4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.646353:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439975 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646378:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439975 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646388:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:1.0:1776187966.646391:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.646395:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439975 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.646400:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439975 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.646409:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008f4c75a3 reply state 00000000853d54dc transno 4294975025 ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.646501:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f4c75a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+486:11303:x1862467653398144:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2574us (6633us total) trans 4294975025 rc 0/0 00000100:00100000:1.0:1776187966.646510:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15308 00010000:00010000:2.0:1776187966.649071:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.649081:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.649096:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.649100:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.649109:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.649130:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25f:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187966.649133:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.649137:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.649142:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43998a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.649221:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.649223:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.649224:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.654972:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.654992:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655000:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655006:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d26d87db already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.655011:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655019:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655040:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0xf2061246 (00000000f056c6a6) 00010000:00010000:2.0:1776187966.655043:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.655049:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655055:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee43997c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xf2061246 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655082:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655087:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655093:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655098:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c48750ea already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.655100:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655105:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655111:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25f:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187966.655114:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187966.655115:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.655120:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439983 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x25f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.659212:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.659296:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653398272 00000100:00100000:2.0:1776187966.659353:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4432 00000100:00100000:2.0:1776187966.659430:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090b78af5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+485:11303:x1862467653398272:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.660334:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090b78af5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+486:11303:x1862467653398272:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 968us (1133us total) trans 4294975026 rc 0/0 00000100:00100000:2.0:1776187966.660348:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4432 00000100:00100000:0.0:1776187966.662309:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.662537:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653398400 00000100:00100000:2.0:1776187966.662630:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4433 00000100:00100000:2.0:1776187966.662637:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+486:11304:x1862467653398400:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.662895:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+487:11304:x1862467653398400:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 238us (573us total) trans 4294975027 rc 0/0 00000100:00100000:2.0:1776187966.662903:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4433 00000100:00100000:3.0:1776187966.669088:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.669190:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653398528 00000100:00100000:1.0:1776187966.669268:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15309 00000100:00100000:1.0:1776187966.669275:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070ebc396 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+487:11304:x1862467653398528:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.669335:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1776187966.669380:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba428966/0x92b1eb87ee4240d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x237:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3e29 expref: 487 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669402:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ed6eda97/0x92b1eb87ee41f05f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x237:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21d5 expref: 486 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669420:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fde6d566/0x92b1eb87ee4240f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x237:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3e37 expref: 485 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669432:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000effe7713/0x92b1eb87ee41f04a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x237:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21ce expref: 484 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669442:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x237:0x0].0x0 (0000000049ca0a1b) 00010000:00010000:1.0:1776187966.669460:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x233:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa7f expref: 483 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669469:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x233:0x0].0x0 (00000000d2b686e5) 00010000:00010000:1.0:1776187966.669473:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.669506:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439991 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x233:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669522:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439991 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669532:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439991 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669547:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669555:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669704:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669843:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x237:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669852:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.669860:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187966.673337:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].415, 64 off34816 00000040:00080000:0.0:1776187966.673388:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4706, 184 off827760 00010000:00010000:0.0:1776187966.673506:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x237:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673527:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673540:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673549:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673556:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673574:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673602:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.673630:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000070ebc396 reply state 000000007d653a2f transno 4294975028 ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x237:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673696:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439991 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673703:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439991 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673710:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439991 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673717:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000474fd8b4 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.673721:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439991 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673728:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439991 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673741:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x233:0x0].0x0 (00000000d2b686e5) 00010000:00010000:0.0:1776187966.673744:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.673749:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439991 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.673756:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439991 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.673768:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000070ebc396 reply state 000000007d653a2f transno 4294975028 ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.673921:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070ebc396 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+484:11304:x1862467653398528:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 4643us (4840us total) trans 4294975028 rc 0/0 00000100:00100000:0.0:1776187966.673932:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15309 00010000:00010000:1.0:1776187966.674745:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187966.674750:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.674762:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000862e8a84 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187966.674765:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.674772:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.674783:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x237:0x0].0x0 (00000000889219c6) 00010000:00010000:1.0:1776187966.674786:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187966.674788:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.674793:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000862e8a84/0x92b1eb87ee4399a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x237:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.674817:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.674818:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.674820:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187966.683631:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187966.683792:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683817:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683826:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683833:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0ab918b already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.683837:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683846:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683866:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x233:0x0].0x1e68dc46 (000000003d48dd25) 00010000:00010000:2.0:1776187966.683870:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.683900:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683908:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439998 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x233:0x0].0x1e68dc46 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683930:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683936:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683941:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683947:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.683949:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683955:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683963:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x237:0x0].0x0 (00000000889219c6) 00010000:00010000:2.0:1776187966.683965:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187966.683967:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.683972:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43999f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x237:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.684166:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653398656 00000100:00100000:0.0:1776187966.684229:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15310 00000100:00100000:0.0:1776187966.684237:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f1860e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+483:11303:x1862467653398656:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.684289:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187966.684308:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000db2d04fd/0x92b1eb87ee42b23d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x265:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c65c8 expref: 483 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684323:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e91a3e1f/0x92b1eb87ee426cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x265:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4c5a expref: 482 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684340:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000688aeeec/0x92b1eb87ee426d4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x265:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4c8b expref: 481 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684352:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a441285f/0x92b1eb87ee420256 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x265:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c293e expref: 480 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684485:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x265:0x0].0x0 (00000000b871d4f3) 00010000:00010000:0.0:1776187966.684494:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.684526:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4399ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684541:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4399ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684550:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4399ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684645:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684655:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684662:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684767:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x265:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684782:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.684789:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.684983:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.685534:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653398784 00000100:00100000:2.0:1776187966.685584:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4434 00000100:00100000:2.0:1776187966.685589:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d12b55ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+480:11304:x1862467653398784:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.685815:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d12b55ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+481:11304:x1862467653398784:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 213us (821us total) trans 4294975029 rc 0/0 00000100:00100000:2.0:1776187966.685823:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4434 00000040:00080000:0.0:1776187966.693691:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].416, 64 off34880 00000040:00080000:0.0:1776187966.693724:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4707, 184 off827944 00010000:00010000:0.0:1776187966.693830:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x265:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.693851:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.693865:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.693897:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.693906:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.693913:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.693929:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.693956:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002f1860e1 reply state 00000000642843aa transno 4294975030 ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x265:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.694021:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4399ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.694028:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4399ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.694035:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4399ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.694041:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a152635 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.694045:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4399ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.694052:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4399ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.694064:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:0.0:1776187966.694067:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.694072:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4399ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.694078:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee4399ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.694087:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002f1860e1 reply state 00000000642843aa transno 4294975030 ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.694246:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.694251:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.694258:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005ac9bdea already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.694261:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.694266:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.694275:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x265:0x0].0x0 (000000003dd9608e) 00010000:00010000:3.0:1776187966.694277:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.694279:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.694285:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005ac9bdea/0x92b1eb87ee4399c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x265:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.694295:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.694296:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.694298:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.695160:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f1860e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+482:11303:x1862467653398656:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 10919us (11601us total) trans 4294975030 rc 0/0 00000100:00100000:0.0:1776187966.695176:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15310 00000100:00100000:3.0:1776187966.695313:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.695498:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653398912 00000100:00100000:0.0:1776187966.695542:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15311 00000100:00100000:0.0:1776187966.695548:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057ec2aa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+482:11304:x1862467653398912:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.695595:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187966.695617:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a366dedd/0x92b1eb87ee42421a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x239:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3e92 expref: 482 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.695636:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000198ba795/0x92b1eb87ee41f123 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x239:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2229 expref: 481 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.695646:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002b3451ba/0x92b1eb87ee424267 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x239:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3eae expref: 480 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.695657:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082045b83/0x92b1eb87ee41f10e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x239:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c221b expref: 479 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.695679:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x239:0x0].0x0 (000000004697d32d) 00010000:00010000:0.0:1776187966.695688:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.695723:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4399c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x233:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.695738:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4399c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.695748:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4399c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.695767:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.695774:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.695780:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.696093:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x239:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.696103:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.696110:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x239:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187966.697072:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].417, 64 off34944 00000040:00080000:0.0:1776187966.697098:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4708, 184 off828128 00010000:00010000:0.0:1776187966.697170:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x239:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697185:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x239:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697194:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x239:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697220:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x239:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697227:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x239:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697235:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x239:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697482:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.697503:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000057ec2aa0 reply state 000000003ac79fb6 transno 4294975031 ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x239:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697556:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4399c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697563:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4399c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697569:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4399c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697576:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000059fd37 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.697579:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4399c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697586:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4399c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697603:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x233:0x0].0x0 (00000000d2b686e5) 00010000:00010000:0.0:1776187966.697606:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.697609:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4399c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.697615:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee4399c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.697626:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000057ec2aa0 reply state 000000003ac79fb6 transno 4294975031 ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.697729:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057ec2aa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+480:11304:x1862467653398912:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2177us (2414us total) trans 4294975031 rc 0/0 00000100:00100000:0.0:1776187966.697741:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15311 00010000:00010000:3.0:1776187966.700949:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.700973:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.700981:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.700988:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000af78cd92 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.700991:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.700999:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.701016:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x3afecd66 (0000000014211482) 00010000:00010000:3.0:1776187966.701019:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.701024:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.701030:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af78cd92/0x92b1eb87ee4399b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x3afecd66 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.701051:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.701057:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.701063:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.701074:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc9474fb already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.701076:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.701082:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.701089:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x265:0x0].0x0 (000000003dd9608e) 00010000:00010000:3.0:1776187966.701091:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.701093:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.701099:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee4399bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x265:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.704302:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187966.704650:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704676:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704684:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704689:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.704693:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704700:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704718:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x233:0x0].0xdf197568 (000000000f84370d) 00010000:00010000:0.0:1776187966.704721:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.704725:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704731:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee4399d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x233:0x0].0xdf197568 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704750:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x239:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704756:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x239:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704762:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x239:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704766:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059094af5 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.704768:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x239:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704772:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x239:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704778:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x239:0x0].0x0 (00000000a7c2e43a) 00010000:00010000:0.0:1776187966.704780:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.704782:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x239:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.704791:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee4399d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x239:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.705388:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653399040 00000100:00100000:1.0:1776187966.705449:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4435 00000100:00100000:1.0:1776187966.705457:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a482f139 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+478:11304:x1862467653399040:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.705705:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a482f139 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+479:11304:x1862467653399040:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 248us (1412us total) trans 4294975032 rc 0/0 00000100:00100000:1.0:1776187966.705714:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4435 00010000:00010000:2.0:1776187966.706745:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187966.706755:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x239:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.706770:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000095ae11d5 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187966.706773:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x239:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.706782:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x239:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.706801:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x239:0x0].0x0 (00000000a7c2e43a) 00010000:00010000:2.0:1776187966.706988:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.706993:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 1/0,0 mode: --/PW res: [0x200000401:0x239:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.707001:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee4399de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x239:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.707022:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.707024:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.707026:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187966.708722:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.708821:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653399168 00000100:00100000:0.0:1776187966.708901:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4436 00000100:00100000:0.0:1776187966.708908:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004feec34b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+479:11303:x1862467653399168:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.709120:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004feec34b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+480:11303:x1862467653399168:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 210us (405us total) trans 4294975033 rc 0/0 00000100:00100000:0.0:1776187966.709128:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4436 00000100:00100000:3.0:1776187966.714123:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.714246:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.716034:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653399296 00000100:00100000:2.0:1776187966.716117:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653399424 00000100:00100000:2.0:1776187966.716180:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15312 00000100:00100000:2.0:1776187966.716187:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049e513ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+481:11303:x1862467653399424:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.716378:0:5515:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.716410:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000edf10af9/0x92b1eb87ee42af73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x250:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c64b7 expref: 481 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716436:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001f237c28/0x92b1eb87ee4257de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x250:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c45c3 expref: 480 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716448:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004ffc48c5/0x92b1eb87ee42587f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x250:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c45fb expref: 479 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716460:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c4f1ed34/0x92b1eb87ee41fa4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x250:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25cc expref: 478 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716470:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x250:0x0].0x0 (00000000453de384) 00010000:00010000:2.0:1776187966.716479:0:5515:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.716510:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4399e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716526:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4399e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716535:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4399e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716549:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716556:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716562:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716810:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x250:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716821:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.716829:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.717356:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].417, 64 off34944 00000040:00080000:2.0:1776187966.717382:0:5515:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4709, 184 off828312 00010000:00010000:2.0:1776187966.717457:0:5515:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x250:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717469:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717479:0:5515:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717487:0:5515:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717494:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717502:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717530:0:5515:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.717548:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000049e513ee reply state 00000000a3181c64 transno 4294975034 ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x250:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717597:0:5515:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4399e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717605:0:5515:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4399e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717612:0:5515:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4399e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717619:0:5515:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aea18492 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.717622:0:5515:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4399e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717629:0:5515:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4399e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717640:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:2.0:1776187966.717642:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.717646:0:5515:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4399e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.717651:0:5515:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee4399e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.717660:0:5515:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000049e513ee reply state 00000000a3181c64 transno 4294975034 ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.717802:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.717808:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.717815:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006b72ffb6 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.717818:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.717825:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.717835:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x250:0x0].0x0 (0000000063901265) 00010000:00010000:0.0:1776187966.717837:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.717839:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.717845:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee4399fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x250:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308433826240 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.717857:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.717858:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.717860:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.718068:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049e513ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+479:11303:x1862467653399424:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1879us (3821us total) trans 4294975034 rc 0/0 00000100:00100000:2.0:1776187966.718078:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15312 00000100:00100000:1.0:1776187966.718191:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15313 00000100:00100000:1.0:1776187966.718208:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006a4217b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+478:11304:x1862467653399296:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.718245:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.718263:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dfb12dc6/0x92b1eb87ee423fc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x235:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3dd5 expref: 478 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718278:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eaf46ee0/0x92b1eb87ee41ef4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x235:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c216c expref: 477 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718288:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001bef811d/0x92b1eb87ee424006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x235:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3df8 expref: 476 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718299:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a78c42fe/0x92b1eb87ee41ef24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x235:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c215e expref: 475 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718307:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x235:0x0].0x0 (00000000415982fa) 00010000:00010000:1.0:1776187966.718316:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.718335:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x233:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718345:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718352:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718363:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718369:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718375:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718454:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x235:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718463:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718470:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.718777:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].418, 64 off35008 00000040:00080000:1.0:1776187966.718795:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4710, 184 off828496 00010000:00010000:1.0:1776187966.718844:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x235:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718858:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718866:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718904:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718912:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718918:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718942:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.718955:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006a4217b8 reply state 0000000000fe994d transno 4294975035 ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x235:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718991:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.718998:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.719004:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.719010:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002adbeaf3 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.719014:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.719020:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.719029:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x233:0x0].0x0 (00000000d2b686e5) 00010000:00010000:1.0:1776187966.719031:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.719034:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.719039:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x233:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.719047:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006a4217b8 reply state 0000000000fe994d transno 4294975035 ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.719097:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a4217b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+476:11304:x1862467653399296:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 898us (4982us total) trans 4294975035 rc 0/0 00000100:00100000:1.0:1776187966.719105:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15313 00010000:00010000:3.0:1776187966.719833:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187966.719839:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.719851:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.719854:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.719862:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.720055:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x235:0x0].0x0 (0000000077c38ae7) 00010000:00010000:3.0:1776187966.720058:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.720061:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.720068:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439a16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x235:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.720080:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.720081:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187966.720083:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.727187:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727218:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727224:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727230:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfd2bd90 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.727234:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727241:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727259:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x17d46a (000000001efc7c4f) 00010000:00010000:2.0:1776187966.727262:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.727266:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727271:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee4399ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x17d46a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727289:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727295:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727301:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727306:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025e5acf1 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.727308:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727313:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727320:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x250:0x0].0x0 (0000000063901265) 00010000:00010000:2.0:1776187966.727322:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187966.727324:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.727329:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee4399f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x250:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729822:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729842:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729849:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729856:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6dd5963 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.729860:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729867:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729920:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x233:0x0].0xeff62052 (000000001c12b283) 00010000:00010000:0.0:1776187966.729923:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.729927:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729933:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439a08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x233:0x0].0xeff62052 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729953:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729966:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729972:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729978:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006aa2e88c already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.729980:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729986:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.729994:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x235:0x0].0x0 (0000000077c38ae7) 00010000:00010000:0.0:1776187966.729996:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.729998:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.730003:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439a0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x235:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.732217:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.732260:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.732376:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653399552 00000100:00100000:1.0:1776187966.732432:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4437 00000100:00100000:1.0:1776187966.732440:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+474:11304:x1862467653399552:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.732853:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+475:11304:x1862467653399552:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 412us (642us total) trans 4294975036 rc 0/0 00000100:00100000:1.0:1776187966.732862:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4437 00000100:00100000:2.0:1776187966.734509:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653399616 00000100:00100000:2.0:1776187966.734608:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15314 00000100:00100000:2.0:1776187966.734615:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1f10cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+475:11392:x1862467653399616:12345-192.168.204.20@tcp:101:ll_sa_11304.0 00010000:00010000:2.0:1776187966.734635:0:5515:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187966.734658:0:5515:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caab7 expref: -99 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.734703:0:5515:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab7 expref: 476 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.734717:0:5515:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab7 expref: 476 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.734726:0:5515:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:2.0:1776187966.734729:0:5515:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.734732:0:5515:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000025e5acf1, rc 0) 00000100:00100000:2.0:1776187966.734792:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1f10cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+476:11392:x1862467653399616:12345-192.168.204.20@tcp:101:ll_sa_11304.0 Request processed in 177us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.734800:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15314 00000100:00100000:0.0:1776187966.738353:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.738452:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.738504:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653399744 00000100:00100000:3.0:1776187966.738557:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4438 00000100:00100000:3.0:1776187966.738563:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef5c0c7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+476:11303:x1862467653399744:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187966.738801:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef5c0c7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+477:11303:x1862467653399744:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 236us (467us total) trans 4294975037 rc 0/0 00000100:00100000:3.0:1776187966.738809:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4438 00000100:00100000:0.0:1776187966.743673:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.743757:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.743805:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653399936 00000100:00100000:3.0:1776187966.743861:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4439 00000100:00100000:3.0:1776187966.743870:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f15623f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+477:11392:x1862467653399936:12345-192.168.204.20@tcp:37:ll_sa_11304.0 00000100:00100000:1.0:1776187966.745992:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653399872 00000100:00100000:1.0:1776187966.746081:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15315 00000100:00100000:1.0:1776187966.746089:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e152b950 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+479:11304:x1862467653399872:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.746145:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1776187966.746177:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005ed1756f/0x92b1eb87ee43872a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x204:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca7e6 expref: 479 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.746215:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000008b5c24a/0x92b1eb87ee421cc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x204:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c326e expref: 478 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.746229:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee421d22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x204:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3291 expref: 477 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.746240:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000093170318/0x92b1eb87ee41db20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x204:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1962 expref: 476 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.746250:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x204:0x0].0x0 (0000000082c85c80) 00010000:00010000:1.0:1776187966.746266:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009723c662/0x92b1eb87ee438cb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x202:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9b4 expref: 475 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.746273:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:1.0:1776187966.746276:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.746309:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.746323:0:5517:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab7 expref: 474 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.746330:0:5517:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.746380:0:5517:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab7 expref: 474 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.746394:0:5517:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab7 expref: 474 pid: 5515 timeout: 543 lvb_type: 0 00000100:00100000:1.0:1776187966.746407:0:5517:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f9a96ac pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5517:1862467659897024:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187966.746496:0:5517:0:(client.c:2500:ptlrpc_set_wait()) set 0000000004e79992 going to sleep for 43 seconds 00000100:00100000:3.0:1776187966.748984:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653400064 00000100:00100000:3.0:1776187966.749076:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15316 00000100:00100000:3.0:1776187966.749084:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000558a9922 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+475:11303:x1862467653400064:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.749144:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.749176:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000d8efa94/0x92b1eb87ee42af96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x252:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c64c5 expref: 475 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749211:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8f23d87/0x92b1eb87ee425a1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x252:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4680 expref: 474 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749224:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000afc25ea6/0x92b1eb87ee425a77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x252:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c46aa expref: 473 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749235:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002b6ad73d/0x92b1eb87ee41fb10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x252:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2620 expref: 472 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749245:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x252:0x0].0x0 (000000002ea06584) 00010000:00010000:3.0:1776187966.749254:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.749288:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439a2b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749303:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439a2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749313:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439a2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749327:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749650:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749659:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749784:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x252:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749793:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.749800:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187966.750256:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].418, 64 off35008 00000040:00080000:3.0:1776187966.750278:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4711, 184 off828680 00010000:00010000:3.0:1776187966.750351:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x252:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750362:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750370:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750378:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750384:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750390:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750414:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187966.750435:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000558a9922 reply state 00000000b7a95dc1 transno 4294975038 ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x252:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750485:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439a2b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750490:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439a2b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750496:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439a2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750501:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.750505:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439a2b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750511:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439a2b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750521:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:3.0:1776187966.750523:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.750527:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439a2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.750532:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439a2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187966.750541:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000558a9922 reply state 00000000b7a95dc1 transno 4294975038 ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.750638:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000558a9922 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+473:11303:x1862467653400064:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1552us (6879us total) trans 4294975038 rc 0/0 00000100:00100000:3.0:1776187966.750646:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15316 00010000:00010000:0.0:1776187966.751192:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.751207:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.751216:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000900c220d already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.751218:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.751225:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.751235:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x252:0x0].0x0 (000000006882895f) 00010000:00010000:0.0:1776187966.751237:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.751239:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.751245:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439a40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x252:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.751256:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.751257:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.751259:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.754178:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f15623f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+471:11392:x1862467653399936:12345-192.168.204.20@tcp:37:ll_sa_11304.0 Request processed in 10299us (10515us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.754204:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4439 00010000:00010000:3.0:1776187966.756572:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756592:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756600:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756607:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000019adf367 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.756611:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756620:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756636:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0xc3f00931 (000000004e9c3dd8) 00010000:00010000:3.0:1776187966.756639:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.756644:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756650:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439a32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xc3f00931 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756680:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756689:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756695:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756700:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035ee1513 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.756702:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756708:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756716:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x252:0x0].0x0 (000000006882895f) 00010000:00010000:3.0:1776187966.756719:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.756721:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.756726:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439a39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x252:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.758455:0:5517:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f9a96ac pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5517:1862467659897024:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187966.758493:0:5517:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.759363:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.759441:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653400192 00000100:00100000:0.0:1776187966.759500:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4440 00000100:00100000:0.0:1776187966.759507:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+470:11303:x1862467653400192:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.759824:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+471:11303:x1862467653400192:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 315us (468us total) trans 4294975039 rc 0/0 00000100:00100000:0.0:1776187966.759836:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4440 00000100:00100000:3.0:1776187966.765004:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.765231:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653400320 00000100:00100000:2.0:1776187966.765290:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15317 00000100:00100000:2.0:1776187966.765297:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093a34e6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+471:11303:x1862467653400320:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.765364:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.765394:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005e9ad988/0x92b1eb87ee42a3b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c6050 expref: 471 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765416:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cdaf3ded/0x92b1eb87ee4253d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4465 expref: 470 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765428:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a6277758/0x92b1eb87ee42543b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24c:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4488 expref: 469 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765444:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000021b093ce/0x92b1eb87ee41f8a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24c:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2516 expref: 468 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765453:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24c:0x0].0x0 (000000007844ace1) 00010000:00010000:2.0:1776187966.765462:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.765498:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439a47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765513:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439a47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765526:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439a47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765540:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765546:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765551:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765683:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765692:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.765704:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.766144:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].419, 64 off35072 00000040:00080000:2.0:1776187966.766166:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4712, 184 off828864 00010000:00010000:2.0:1776187966.766243:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.766254:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.766262:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.766270:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.766276:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.766282:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.766993:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.767025:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000093a34e6a reply state 000000009a7357d3 transno 4294975040 ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.767370:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.767377:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.767385:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.767388:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.767395:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.767410:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24c:0x0].0x0 (000000001efc7c4f) 00010000:00010000:1.0:1776187966.767414:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439a47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.767414:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.767417:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.767423:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439a47 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.767424:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.767429:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439a47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.767434:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfd2bd90 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.767436:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.767437:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439a47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.767437:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.767438:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.767442:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439a47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.767456:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:1.0:1776187966.767458:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.767460:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439a47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.767465:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439a47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.767474:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000093a34e6a reply state 000000009a7357d3 transno 4294975040 ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.767582:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093a34e6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+469:11303:x1862467653400320:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2280us (2585us total) trans 4294975040 rc 0/0 00000100:00100000:1.0:1776187966.767592:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15317 00000100:00100000:1.0:1776187966.769641:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.769712:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653400384 00010000:00010000:3.0:1776187966.769751:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab7 expref: 469 pid: 5515 timeout: 543 lvb_type: 0 00000100:00100000:3.0:1776187966.769796:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4313 00000100:00100000:3.0:1776187966.769803:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f9a96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+469:2222:x1862467653400384:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187966.769821:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187966.769826:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab7 expref: 469 pid: 5515 timeout: 543 lvb_type: 0 00010000:00010000:3.0:1776187966.769838:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab7 expref: 469 pid: 5515 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187966.769929:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.769933:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caab7 expref: 469 pid: 5515 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187966.769939:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.769947:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:0.0:1776187966.769949:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.769951:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.769955:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aea18492 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.769958:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.769961:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.769966:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.769968:0:7121:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.769974:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0xa5e17578 (0000000063901265) 00010000:00010000:0.0:1776187966.769976:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.769979:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.769984:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xa5e17578 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.769996:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.769997:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.770003:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.770007:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.770012:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c8d05e already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.770014:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.770019:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.770043:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f9a96ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+468:2222:x1862467653400384:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 240us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.770051:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4313 00010000:00010000:2.0:1776187966.770327:0:5517:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.770342:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.770365:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.770375:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.770383:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.770498:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x204:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.770506:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.770512:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.771008:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24c:0x0].0x0 (000000001efc7c4f) 00010000:00010000:0.0:1776187966.771013:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.771017:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.771122:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a55 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1776187966.771805:0:5517:0:(mdd_dir.c:1577:mdd_finish_unlink()) Object [0x200000401:0x204:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1776187966.771870:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4713, 184 off829048 00000004:00010000:1.0:1776187966.772182:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e152b950 reply state 00000000a54bff41 transno 4294975041 ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.772209:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.772216:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.772223:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.772233:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002adbeaf3 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.772236:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.772326:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.772340:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:1.0:1776187966.772342:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.772345:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.772350:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439a24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.772360:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e152b950 reply state 00000000a54bff41 transno 4294975041 ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.772487:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e152b950 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+468:11304:x1862467653399872:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 26395us (34032us total) trans 4294975041 rc 0/0 00000100:00100000:1.0:1776187966.772497:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15315 00000100:00100000:1.0:1776187966.774460:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187966.775314:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775333:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775341:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775347:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006dbc9deb already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.775352:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775358:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775378:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x4e78d319 (0000000021698773) 00010000:00010000:0.0:1776187966.775380:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.775385:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775390:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee439a63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x202:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775413:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775418:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775423:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775428:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000b7eaa4a already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.775430:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775435:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775441:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x204:0x0].0x0 (00000000780f5f5c) 00010000:00010000:0.0:1776187966.775443:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.775444:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.775449:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee439a6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x204:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.775547:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653400512 00000100:00100000:2.0:1776187966.775603:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4441 00000100:00100000:2.0:1776187966.775611:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000168460a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+467:11303:x1862467653400512:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.775912:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000168460a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+468:11303:x1862467653400512:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 299us (1459us total) trans 4294975042 rc 0/0 00000100:00100000:2.0:1776187966.775921:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4441 00000100:00100000:3.0:1776187966.776865:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.778504:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653400640 00000100:00100000:2.0:1776187966.778570:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4442 00000100:00100000:2.0:1776187966.778577:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a29ae26 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+468:11304:x1862467653400640:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.778831:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a29ae26 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+469:11304:x1862467653400640:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 254us (1970us total) trans 4294975043 rc 0/0 00000100:00100000:2.0:1776187966.778845:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4442 00000100:00100000:3.0:1776187966.779106:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.779770:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653400768 00000100:00100000:2.0:1776187966.779812:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15318 00000100:00100000:2.0:1776187966.779817:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8eddfe4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+469:11303:x1862467653400768:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.779851:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.779907:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006c04076a/0x92b1eb87ee42b19c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x261:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c6589 expref: 469 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.779937:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007bb335e6/0x92b1eb87ee4268bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x261:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4b0a expref: 468 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.779949:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000016a50e89/0x92b1eb87ee426926 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x261:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4b2d expref: 467 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.779960:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006f3731b2/0x92b1eb87ee4200ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x261:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2896 expref: 466 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.779971:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x261:0x0].0x0 (0000000036664ab9) 00010000:00010000:2.0:1776187966.779984:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.780024:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439a71 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.780043:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.780054:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.780068:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.780074:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.780080:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.780190:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x261:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.780209:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.780215:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.780600:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].419, 64 off35072 00000040:00080000:2.0:1776187966.780626:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4714, 184 off829232 00010000:00010000:2.0:1776187966.781002:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x261:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781014:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781023:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781032:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781038:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781043:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781073:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.781091:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c8eddfe4 reply state 0000000075b49b65 transno 4294975044 ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x261:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.781104:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.781110:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.781118:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c8d05e already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.781122:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.781129:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.781140:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x261:0x0].0x0 (000000007659c27e) 00010000:00010000:0.0:1776187966.781142:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.781144:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439a71 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.781146:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781151:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439a71 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.781152:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee439a86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x261:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781156:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439a71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781160:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.781162:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439a71 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.781163:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.781164:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.781166:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.781167:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439a71 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781179:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:2.0:1776187966.781181:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.781183:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439a71 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.781188:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439a71 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.781206:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c8eddfe4 reply state 0000000075b49b65 transno 4294975044 ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.781295:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8eddfe4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+467:11303:x1862467653400768:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1475us (2188us total) trans 4294975044 rc 0/0 00000100:00100000:2.0:1776187966.781304:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15318 00010000:00010000:0.0:1776187966.784632:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784657:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784665:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784683:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002df099c7 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.784689:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784699:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784717:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0xbcf75103 (000000007e00579b) 00010000:00010000:0.0:1776187966.784720:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.784725:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784733:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee439a78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0xbcf75103 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784759:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784765:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784770:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784774:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001be7b27e already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.784777:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784782:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784790:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x261:0x0].0x0 (000000007659c27e) 00010000:00010000:0.0:1776187966.784792:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.784794:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.784799:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee439a7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x261:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.785190:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.785298:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653400896 00000100:00100000:2.0:1776187966.785359:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15319 00000100:00100000:2.0:1776187966.785366:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000168460a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+466:11304:x1862467653400896:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.785430:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.785454:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000038dcc6ff/0x92b1eb87ee42209b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x207:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c33b7 expref: 466 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785470:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000be260671/0x92b1eb87ee41dce0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x207:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a0a expref: 465 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785483:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ec99ce16/0x92b1eb87ee4220e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x207:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c33d3 expref: 464 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785500:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000021df64f4/0x92b1eb87ee41dccb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x207:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19fc expref: 463 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785509:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x207:0x0].0x0 (000000007246cc91) 00010000:00010000:2.0:1776187966.785517:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.785555:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785570:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785580:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785596:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785602:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785608:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785734:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x207:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785742:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.785753:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.786209:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].420, 64 off35136 00000040:00080000:2.0:1776187966.786231:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4715, 184 off829416 00010000:00010000:2.0:1776187966.786293:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x207:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.786303:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.786311:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.786318:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.786323:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.786329:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.786352:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.786371:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000168460a5 reply state 00000000e21ee4ce transno 4294975045 ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x207:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.786390:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.786395:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.786401:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfd2bd90 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.786404:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.786410:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.786414:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.786420:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x207:0x0].0x0 (0000000090869b29) 00010000:00010000:0.0:1776187966.786422:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.786424:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.786424:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.786430:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.786431:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee439aa2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x207:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.786436:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aea18492 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.786438:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.786441:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.786442:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.786443:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.786444:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.786449:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:2.0:1776187966.786451:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.786453:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.786459:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439a8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.786468:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000168460a5 reply state 00000000e21ee4ce transno 4294975045 ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.786564:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000168460a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+464:11304:x1862467653400896:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1195us (1375us total) trans 4294975045 rc 0/0 00000100:00100000:2.0:1776187966.786572:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15319 00000100:00100000:0.0:1776187966.791207:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.791404:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653401024 00000100:00100000:1.0:1776187966.791462:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4443 00000100:00100000:1.0:1776187966.791468:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f15623f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+464:11304:x1862467653401024:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.791711:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f15623f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+465:11304:x1862467653401024:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 242us (519us total) trans 4294975046 rc 0/0 00000100:00100000:1.0:1776187966.791720:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4443 00010000:00010000:3.0:1776187966.794703:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.794734:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.794863:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.794930:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.795146:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653401152 00000100:00100000:2.0:1776187966.795208:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15320 00000100:00100000:2.0:1776187966.795214:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d60ddf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+465:11304:x1862467653401152:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.795274:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.795298:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee438d35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x206:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9d7 expref: 465 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795318:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee421ec6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x206:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c330f expref: 464 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795330:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000afac4aad/0x92b1eb87ee421f44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x206:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3340 expref: 463 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795568:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d33840c0/0x92b1eb87ee41dc07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x206:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19af expref: 462 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795578:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x206:0x0].0x0 (0000000080ce8de2) 00010000:00010000:2.0:1776187966.795588:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.795622:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439aa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795637:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439aa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795647:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439aa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795726:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795737:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025e5acf1 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.795740:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795748:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795757:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x8344d724 (00000000d80c9c1b) 00010000:00010000:3.0:1776187966.795760:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.795762:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795763:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795770:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee439a94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x202:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795771:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795778:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795784:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795788:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795793:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795801:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.795804:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795809:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795816:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x207:0x0].0x0 (0000000090869b29) 00010000:00010000:3.0:1776187966.795818:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.795820:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.795824:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee439a9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x207:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795907:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x206:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795915:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.795922:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.796525:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].420, 64 off35136 00000040:00080000:2.0:1776187966.796548:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4716, 184 off829600 00000100:00100000:3.0:1776187966.796606:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653401280 00010000:00010000:2.0:1776187966.796615:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x206:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.796629:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.796639:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.796648:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.796655:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.796661:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4444 00000100:00100000:3.0:1776187966.796670:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036115f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+462:11303:x1862467653401280:12345-192.168.204.20@tcp:35:dbench.0 00010000:00010000:2.0:1776187966.796822:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.796835:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1776187966.796848:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036115f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+463:11303:x1862467653401280:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 178us (1918us total) trans 4294975048 rc 0/0 00000004:00010000:2.0:1776187966.796849:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b9d60ddf reply state 000000007cb83631 transno 4294975047 ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x206:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.796856:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4444 00010000:00010000:2.0:1776187966.796940:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439aa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.796947:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439aa9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.796952:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439aa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.796958:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006b72ffb6 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.796962:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439aa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.797112:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439aa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.797126:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:2.0:1776187966.797129:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.797132:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439aa9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.797138:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439aa9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.797147:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b9d60ddf reply state 000000007cb83631 transno 4294975047 ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.797148:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.797152:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.797158:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089fb6120 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.797160:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.797165:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.797174:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x206:0x0].0x0 (00000000780f5f5c) 00010000:00010000:0.0:1776187966.797176:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.797177:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.797182:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee439abe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x206:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.797184:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d60ddf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+463:11304:x1862467653401152:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1969us (2328us total) trans 4294975047 rc 0/0 00000100:00100000:2.0:1776187966.797191:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15320 00010000:00010000:0.0:1776187966.797204:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.797205:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.797207:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187966.800990:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801010:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801016:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801023:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d81ab485 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.801028:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801034:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801052:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x30480a6c (0000000079764c80) 00010000:00010000:2.0:1776187966.801056:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.801059:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801066:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439ab0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x202:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801085:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801091:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801096:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801101:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092776876 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.801103:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801108:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801115:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x206:0x0].0x0 (00000000780f5f5c) 00010000:00010000:2.0:1776187966.801117:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187966.801120:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.801125:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439ab7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x206:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.802207:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.802398:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653401408 00000100:00100000:2.0:1776187966.802444:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15321 00000100:00100000:2.0:1776187966.802451:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c5172b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+462:11303:x1862467653401408:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.802540:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187966.802566:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d441e326/0x92b1eb87ee42b1f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x263:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c65ac expref: 462 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802587:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000476255c4/0x92b1eb87ee426ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x263:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4b9d expref: 461 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802599:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000963abcc5/0x92b1eb87ee426b10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x263:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4bc7 expref: 460 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802610:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000664aa0d8/0x92b1eb87ee420192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x263:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28ea expref: 459 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802619:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x263:0x0].0x0 (000000007dd8e1ad) 00010000:00010000:2.0:1776187966.802627:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.802660:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439ac5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802675:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439ac5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802684:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439ac5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802697:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802704:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802710:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802813:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x263:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802820:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.802827:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.803269:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].421, 64 off35200 00000040:00080000:2.0:1776187966.803292:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4717, 184 off829784 00010000:00010000:2.0:1776187966.803357:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 3/0,1 mode: --/PW res: [0x200000401:0x263:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803368:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803377:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803384:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803392:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803398:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803429:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.803448:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007c5172b1 reply state 000000008c32cbca transno 4294975049 ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x263:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.803488:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.803493:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803494:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439ac5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803500:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439ac5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.803501:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a27740b3 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.803504:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803505:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439ac5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803511:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aea18492 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.803513:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439ac5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.803517:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803518:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439ac5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803526:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:0.0:1776187966.803526:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x263:0x0].0x0 (000000001efc7c4f) 00010000:00010000:2.0:1776187966.803529:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.803529:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187966.803532:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439ac5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.803532:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 1/0,0 mode: --/PW res: [0x200000401:0x263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.803537:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee439ada lrc: 0/0,0 mode: --/PW res: [0x200000401:0x263:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.803538:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439ac5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x243:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.803545:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007c5172b1 reply state 000000008c32cbca transno 4294975049 ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.803549:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.803550:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.803551:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.803626:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c5172b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+460:11303:x1862467653401408:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1174us (1435us total) trans 4294975049 rc 0/0 00000100:00100000:2.0:1776187966.803634:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15321 00000100:00100000:0.0:1776187966.808521:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.808721:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653401536 00000100:00100000:1.0:1776187966.808769:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15322 00000100:00100000:1.0:1776187966.808776:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000058b38222 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+460:11304:x1862467653401536:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.808842:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187966.808896:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee438c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca983 expref: 460 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.808919:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38f:0x0].0x0 (00000000a45e680a) 00010000:00010000:1.0:1776187966.808932:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.808965:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439ae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.808983:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439ae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.808993:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439ae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809008:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809014:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809026:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809139:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809148:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809154:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1776187966.809497:0:5517:0:(mdd_dir.c:1577:mdd_finish_unlink()) Object [0x200000401:0x38f:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1776187966.809544:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4718, 184 off829968 00000004:00010000:1.0:1776187966.809636:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000058b38222 reply state 00000000497801a3 transno 4294975050 ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809651:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439ae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809657:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439ae1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809663:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439ae1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809669:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002adbeaf3 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.809673:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439ae1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809684:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439ae1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809694:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:1.0:1776187966.809697:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.809700:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439ae1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.809706:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439ae1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x202:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.809715:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000058b38222 reply state 00000000497801a3 transno 4294975050 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.809822:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000058b38222 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+461:11304:x1862467653401536:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1044us (1309us total) trans 4294975050 rc 0/0 00000100:00100000:1.0:1776187966.809831:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15322 00010000:00010000:1.0:1776187966.810564:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810577:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810583:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810588:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.810591:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810598:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810608:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x98ca20bd (0000000021698773) 00010000:00010000:1.0:1776187966.810611:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.810613:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810618:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee439acc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x243:0x0].0x98ca20bd bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810631:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810636:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810641:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810645:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8111509 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.810647:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810652:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810665:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x263:0x0].0x0 (000000001efc7c4f) 00010000:00010000:1.0:1776187966.810667:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.810669:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.810674:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee439ad3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x263:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813526:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813556:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813566:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813572:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.813577:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813586:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813605:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x17610ee3 (0000000077c38ae7) 00010000:00010000:2.0:1776187966.813608:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.813613:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813619:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439ae8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x202:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813640:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813647:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813652:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813658:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000787789d5 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.813659:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813664:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813671:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38f:0x0].0x0 (000000001c12b283) 00010000:00010000:2.0:1776187966.813673:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187966.813675:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.813680:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439aef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.818623:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.818733:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.818815:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653401600 00000100:00100000:1.0:1776187966.818863:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653401664 00000100:00100000:2.0:1776187966.818928:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4445 00000100:00100000:2.0:1776187966.818936:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e3c369 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+460:11304:x1862467653401600:12345-192.168.204.20@tcp:37:dbench.0 00000100:00100000:1.0:1776187966.820247:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4446 00000100:00100000:1.0:1776187966.820257:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000630996cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+461:11303:x1862467653401664:12345-192.168.204.20@tcp:37:dbench.0 00000100:00100000:3.0:1776187966.829101:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000630996cd pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+461:11303:x1862467653401664:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 8830us (10354us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.829121:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4446 00000100:00100000:2.0:1776187966.830954:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e3c369 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+459:11304:x1862467653401600:12345-192.168.204.20@tcp:37:dbench.0 Request processed in 12012us (12338us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.830968:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4445 00000100:00100000:1.0:1776187966.841558:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.841825:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653401792 00000100:00100000:0.0:1776187966.841920:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4447 00000100:00100000:0.0:1776187966.841966:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014e093c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+459:11304:x1862467653401792:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.842267:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014e093c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+460:11304:x1862467653401792:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 339us (722us total) trans 4294975051 rc 0/0 00000100:00100000:0.0:1776187966.843578:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4447 00000100:00100000:0.0:1776187966.846000:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.846168:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653401920 00000100:00100000:1.0:1776187966.846680:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15323 00000100:00100000:1.0:1776187966.846688:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000630996cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+460:11304:x1862467653401920:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.846747:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1776187966.846773:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000020736325/0x92b1eb87ee42f90f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x270:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c7cff expref: 460 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.846797:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004276d6b1/0x92b1eb87ee42765b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x270:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4fc5 expref: 459 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.846809:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f47d05d/0x92b1eb87ee42772d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x270:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5012 expref: 458 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.846821:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000af2b02dc/0x92b1eb87ee420662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x270:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2adb expref: 457 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.846833:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x270:0x0].0x0 (00000000276fb77d) 00010000:00010000:1.0:1776187966.846850:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa86 expref: 456 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.846859:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26e:0x0].0x0 (0000000062f492a7) 00010000:00010000:1.0:1776187966.846862:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.846949:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439af6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x26e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.846970:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439af6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.846985:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439af6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847006:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847014:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847020:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847162:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x270:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847169:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x270:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847175:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x270:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.847641:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].421, 64 off35200 00000040:00080000:1.0:1776187966.847664:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4719, 184 off830152 00010000:00010000:1.0:1776187966.847725:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x270:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847734:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x270:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847741:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x270:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847748:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x270:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847753:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x270:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847759:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x270:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847777:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.847800:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000630996cd reply state 00000000095c3a0d transno 4294975052 ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x270:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847846:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439af6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x26e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847853:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439af6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x26e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847865:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439af6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x26e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847871:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002adbeaf3 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.847909:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439af6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x26e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847920:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439af6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x26e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847931:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26e:0x0].0x0 (0000000062f492a7) 00010000:00010000:1.0:1776187966.847933:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.847937:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439af6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x26e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.847943:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439af6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x26e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.847953:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000630996cd reply state 00000000095c3a0d transno 4294975052 ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.848054:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000630996cd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+457:11304:x1862467653401920:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1365us (2064us total) trans 4294975052 rc 0/0 00000100:00100000:1.0:1776187966.848063:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15323 00000100:00100000:3.0:1776187966.848235:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.848266:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187966.848327:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.848332:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x270:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.848345:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000787789d5 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.848347:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x270:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.848354:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x270:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.848363:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x270:0x0].0x0 (00000000889219c6) 00010000:00010000:0.0:1776187966.848365:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.848367:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x270:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.848371:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee439b0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x270:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.848382:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.848383:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.848384:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.848404:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402048 00000100:00100000:0.0:1776187966.848444:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4448 00000100:00100000:0.0:1776187966.848450:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2d0ceec pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+457:11303:x1862467653402048:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.848588:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2d0ceec pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+458:11303:x1862467653402048:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 137us (354us total) trans 4294975053 rc 0/0 00000100:00100000:0.0:1776187966.848595:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4448 00010000:00010000:3.0:1776187966.854797:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854817:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854824:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854830:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c460bc60 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.854834:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854841:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854859:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26e:0x0].0xdde1c156 (00000000a45e680a) 00010000:00010000:3.0:1776187966.854863:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.854866:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854889:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c460bc60/0x92b1eb87ee439afd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x26e:0x0].0xdde1c156 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854912:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x270:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854917:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x270:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854923:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x270:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854929:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9325880 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.854931:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x270:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854937:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x270:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854945:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x270:0x0].0x0 (00000000889219c6) 00010000:00010000:3.0:1776187966.854947:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.854949:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x270:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.854954:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee439b04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x270:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.859562:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402112 00000100:00100000:2.0:1776187966.859631:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15324 00000100:00100000:2.0:1776187966.859639:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e6ba762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+457:11396:x1862467653402112:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:2.0:1776187966.859661:0:6573:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187966.859685:0:6573:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439b12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caabe expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.859722:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caabe expref: 458 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.859735:0:6573:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caabe expref: 458 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.859744:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:2.0:1776187966.859747:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.859750:0:6573:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000aea18492, rc 0) 00000100:00100000:2.0:1776187966.859844:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e6ba762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+458:11396:x1862467653402112:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 204us (11577us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.859851:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15324 00000100:00100000:1.0:1776187966.863202:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.863282:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.863289:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402176 00000100:00100000:1.0:1776187966.863309:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.863329:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.863348:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402432 00000100:00100000:2.0:1776187966.863371:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15325 00000100:00100000:2.0:1776187966.863377:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000793c3b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+459:11398:x1862467653402176:12345-192.168.204.20@tcp:101:ll_sa_11304.0 00010000:00010000:2.0:1776187966.863405:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187966.863428:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439b19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x272:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caac5 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863468:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caac5 expref: 460 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863482:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caac5 expref: 460 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863491:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x0 (00000000ed7fe374) 00010000:00010000:2.0:1776187966.863494:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.863498:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092776876, rc 0) 00000100:00100000:2.0:1776187966.863560:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000793c3b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+460:11398:x1862467653402176:12345-192.168.204.20@tcp:101:ll_sa_11304.0 Request processed in 182us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187966.863566:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15325 00000100:00100000:2.0:1776187966.863588:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15326 00000100:00100000:2.0:1776187966.863592:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c6422bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+459:11303:x1862467653402432:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:2.0:1776187966.863629:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1776187966.863646:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee4388d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x205:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca872 expref: 459 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863679:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007ff7bda4/0x92b1eb87ee421dae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x205:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c32c2 expref: 458 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863691:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000020b6a25b/0x92b1eb87ee421e2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x205:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c32e5 expref: 457 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863703:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e74d308d/0x92b1eb87ee41dbe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x205:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19a8 expref: 456 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863710:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x205:0x0].0x0 (0000000072326018) 00010000:00010000:2.0:1776187966.863723:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025a9ff81/0x92b1eb87ee438ff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caa63 expref: 455 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863732:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:2.0:1776187966.863735:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187966.863761:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863770:0:5516:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439b12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caabe expref: 454 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863777:0:5516:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863809:0:5516:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caabe expref: 454 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.863819:0:5516:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439b12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caabe expref: 454 pid: 6573 timeout: 543 lvb_type: 0 00000100:00100000:2.0:1776187966.863830:0:5516:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067f57eeb pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5516:1862467659897088:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187966.863867:0:5516:0:(client.c:2500:ptlrpc_set_wait()) set 0000000079314386 going to sleep for 43 seconds 00000100:00100000:1.0:1776187966.864210:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402304 00000100:00100000:1.0:1776187966.864237:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402496 00000100:00100000:1.0:1776187966.864262:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4449 00000100:00100000:1.0:1776187966.864266:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d23e956 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+456:11304:x1862467653402304:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.864541:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d23e956 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+457:11304:x1862467653402304:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 274us (1258us total) trans 4294975054 rc 0/0 00000100:00100000:1.0:1776187966.864549:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4449 00000100:00100000:1.0:1776187966.864565:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4450 00000100:00100000:1.0:1776187966.864569:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c480202 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+456:11396:x1862467653402496:12345-192.168.204.20@tcp:37:ll_sa_11303.0 00000100:00100000:2.0:1776187966.871185:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.871858:0:5516:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067f57eeb pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5516:1862467659897088:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187966.871918:0:5516:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.872649:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402624 00000100:00100000:3.0:1776187966.872709:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15327 00000100:00100000:3.0:1776187966.872715:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000643fa20e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+458:11304:x1862467653402624:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.872773:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1776187966.872800:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005bdfd3bd/0x92b1eb87ee438627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x278:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca78b expref: 458 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.872821:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a8dbfd03/0x92b1eb87ee4294e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x278:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5af4 expref: 457 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.872833:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000a4127b9/0x92b1eb87ee429579 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x278:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5b2c expref: 456 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.872851:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004176ecad/0x92b1eb87ee42099c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x278:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c1d expref: 455 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.872861:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x278:0x0].0x0 (000000006386c719) 00010000:00010000:3.0:1776187966.872897:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c58d722a/0x92b1eb87ee4290cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x272:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5965 expref: 454 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.872906:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x0 (00000000ed7fe374) 00010000:00010000:3.0:1776187966.872909:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.872941:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.872954:0:12471:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439b19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caac5 expref: 453 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.872961:0:12471:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.873010:0:12471:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caac5 expref: 453 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.873021:0:12471:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439b19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caac5 expref: 453 pid: 5516 timeout: 543 lvb_type: 0 00000100:00100000:3.0:1776187966.873034:0:12471:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4e344b9 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12471:1862467659897152:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187966.873112:0:12471:0:(client.c:2500:ptlrpc_set_wait()) set 0000000020bf3161 going to sleep for 43 seconds 00000100:00100000:2.0:1776187966.873343:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.873614:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402688 00000100:00100000:0.0:1776187966.873651:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4451 00000100:00100000:0.0:1776187966.873657:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+454:11398:x1862467653402688:12345-192.168.204.20@tcp:37:ll_sa_11304.0 00000100:00100000:3.0:1776187966.878575:0:12471:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4e344b9 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12471:1862467659897152:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187966.878606:0:12471:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.879026:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+453:11398:x1862467653402688:12345-192.168.204.20@tcp:37:ll_sa_11304.0 Request processed in 5364us (5680us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.879040:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4451 00000100:00100000:1.0:1776187966.882233:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c480202 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+452:11396:x1862467653402496:12345-192.168.204.20@tcp:37:ll_sa_11303.0 Request processed in 17654us (18894us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187966.882253:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4450 00000100:00100000:2.0:1776187966.883464:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.883573:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402752 00010000:00010000:1.0:1776187966.883611:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439b19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caac5 expref: 452 pid: 5516 timeout: 543 lvb_type: 0 00000100:00100000:1.0:1776187966.883676:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4314 00000100:00100000:1.0:1776187966.883683:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e10840f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+452:2225:x1862467653402752:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1776187966.883697:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187966.883703:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439b19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caac5 expref: 452 pid: 5516 timeout: 543 lvb_type: 0 00010000:00010000:1.0:1776187966.883718:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caac5 expref: 452 pid: 5516 timeout: 543 lvb_type: 0 00010000:00010000:1.0:1776187966.883740:0:5502:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee439b19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caac5 expref: 452 pid: 5516 timeout: 543 lvb_type: 0 00010000:00010000:1.0:1776187966.883753:0:5502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x0 (00000000ed7fe374) 00010000:00010000:1.0:1776187966.883759:0:5502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.883769:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.883777:0:5502:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.883805:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187966.883839:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e10840f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+451:2225:x1862467653402752:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 156us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187966.883846:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4314 00010000:00010000:3.0:1776187966.883857:0:12471:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.883865:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.883924:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.883935:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.883943:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884073:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x278:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884081:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x278:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884087:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x278:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187966.884507:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].422, 64 off35264 00000040:00080000:3.0:1776187966.884530:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4720, 184 off830336 00010000:00010000:3.0:1776187966.884588:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x278:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884598:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884605:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884612:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884617:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884622:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884636:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187966.884655:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000643fa20e reply state 00000000ed12be6f transno 4294975055 ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x278:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884697:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884702:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884707:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884712:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035ee1513 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.884715:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884721:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884730:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x0 (00000000ed7fe374) 00010000:00010000:3.0:1776187966.884733:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.884735:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.884740:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187966.884746:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000643fa20e reply state 00000000ed12be6f transno 4294975055 ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.884800:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000643fa20e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+452:11304:x1862467653402624:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 12083us (13621us total) trans 4294975055 rc 0/0 00000100:00100000:3.0:1776187966.884806:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15327 00010000:00010000:1.0:1776187966.886527:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187966.886537:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.886551:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000503e410b already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187966.886554:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.886566:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.886581:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x278:0x0].0x0 (000000004e9c3dd8) 00010000:00010000:1.0:1776187966.886584:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187966.886587:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.886593:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439b3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x278:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.886610:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.886612:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.886613:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.888927:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.892078:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402816 00000100:00100000:3.0:1776187966.892145:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15328 00000100:00100000:3.0:1776187966.892152:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004db8712a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+452:2224:x1862467653402816:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:3.0:1776187966.892174:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187966.892958:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caacc expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893024:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439b4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893046:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439b4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893059:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439b4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893073:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439b51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893080:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893087:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893211:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893219:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893226:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187966.893277:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x38e:0x0]: returning size 15360 00000004:00200000:3.0:1776187966.893282:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187966.893302:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893313:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893321:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439b4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893328:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439b4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893336:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439b4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893342:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009372d704 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.893346:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439b4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893352:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439b4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893363:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:3.0:1776187966.893366:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.893368:0:12471:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893378:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439b4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893383:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439b4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893394:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893403:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439b51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893407:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439b51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893412:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e57fe368 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.893413:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439b51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893417:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439b51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893423:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x17610ee3 (00000000866a3643) 00010000:00010000:3.0:1776187966.893425:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.893427:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439b51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893431:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439b51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893458:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439b43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caacc expref: 454 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893468:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caacc expref: 453 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.893473:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38e:0x0].0x0 (00000000eb7ad866) 00010000:00010000:3.0:1776187966.893476:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1776187966.893477:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000949deda1, rc 0) 00000100:00100000:3.0:1776187966.894036:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004db8712a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+453:2224:x1862467653402816:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 1881us (5122us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.894046:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15328 00010000:00010000:3.0:1776187966.894598:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894610:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894617:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894622:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000019adf367 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.894625:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894631:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894642:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x8d5ea5b7 (000000006882895f) 00010000:00010000:3.0:1776187966.894645:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.894648:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894654:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439b2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x272:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894670:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x278:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894676:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x278:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894681:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x278:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894687:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.894689:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x278:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894694:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x278:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894700:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x278:0x0].0x0 (000000004e9c3dd8) 00010000:00010000:3.0:1776187966.894702:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.894704:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x278:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.894708:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439b35 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x278:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.896146:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.896350:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653402880 00010000:00010000:0.0:1776187966.896389:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439b12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caabe expref: 452 pid: 6573 timeout: 543 lvb_type: 0 00000100:00100000:0.0:1776187966.896428:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4315 00000100:00100000:0.0:1776187966.896435:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007868c699 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+452:2225:x1862467653402880:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1776187966.896450:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187966.896456:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439b12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caabe expref: 452 pid: 6573 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187966.896467:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caabe expref: 452 pid: 6573 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187966.896486:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee439b12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caabe expref: 452 pid: 6573 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187966.896502:0:7121:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:0.0:1776187966.896506:0:7121:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.896515:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.896522:0:7121:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.896559:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187966.896666:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007868c699 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+451:2225:x1862467653402880:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 230us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.896674:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4315 00010000:00010000:2.0:1776187966.896734:0:5516:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.896744:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.896769:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.896778:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.896786:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.896934:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x205:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.896942:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.896949:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.897349:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].423, 64 off35328 00000040:00080000:2.0:1776187966.897373:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4721, 184 off830520 00010000:00010000:2.0:1776187966.897437:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x205:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897447:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897454:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897466:0:5516:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897472:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897479:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897499:0:5516:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.897520:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006c6422bd reply state 00000000cc84de29 transno 4294975056 ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x205:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897568:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897575:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897580:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897585:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d81ab485 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.897589:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897594:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897608:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:2.0:1776187966.897611:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.897614:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.897619:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439b20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.897626:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000006c6422bd reply state 00000000cc84de29 transno 4294975056 ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.897685:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c6422bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+452:11303:x1862467653402432:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 34091us (34374us total) trans 4294975056 rc 0/0 00000100:00100000:2.0:1776187966.897692:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15326 00010000:00010000:0.0:1776187966.898087:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.898092:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.898099:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009d004fc already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.898102:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.898107:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.898117:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x205:0x0].0x0 (0000000079764c80) 00010000:00010000:0.0:1776187966.898119:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.898121:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.898126:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee439b6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x205:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.898138:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.898140:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.898141:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.899609:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.899695:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653403008 00000100:00100000:1.0:1776187966.899749:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4452 00000100:00100000:1.0:1776187966.899756:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017a5a6fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+452:11304:x1862467653403008:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.900500:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017a5a6fc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+453:11304:x1862467653403008:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 740us (894us total) trans 4294975057 rc 0/0 00000100:00100000:2.0:1776187966.900511:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4452 00010000:00010000:3.0:1776187966.903077:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903097:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903105:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903115:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000006942ede already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.903119:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903126:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903141:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x30480a6c (00000000780f5f5c) 00010000:00010000:3.0:1776187966.903144:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.903147:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903153:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439b5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x30480a6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903169:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903174:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903178:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903182:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006b72ffb6 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.903183:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903187:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903208:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x205:0x0].0x0 (0000000079764c80) 00010000:00010000:3.0:1776187966.903210:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.903212:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.903216:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439b66 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x205:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187966.907034:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.907089:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.907234:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653403136 00000100:00100000:3.0:1776187966.907273:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.908775:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653403328 00000100:00100000:1.0:1776187966.908775:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653403200 00000100:00100000:0.0:1776187966.908844:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15329 00000100:00100000:0.0:1776187966.908852:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e344b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+454:11303:x1862467653403136:12345-192.168.204.20@tcp:36:dbench.0 00000100:00100000:1.0:1776187966.908890:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15330 00000100:00100000:1.0:1776187966.908895:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090b78af5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+454:11304:x1862467653403328:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.908933:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.908961:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee43857f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x274:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca745 expref: 454 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.908994:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1776187966.908998:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004fcf2124/0x92b1eb87ee42922a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x274:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c59ea expref: 453 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909005:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caacc expref: 452 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909011:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f36fe94d/0x92b1eb87ee4292a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x274:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5a1b expref: 451 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909018:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee438d43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38e:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca9de expref: 450 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909023:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e6bb9f93/0x92b1eb87ee42081b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x274:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b7c expref: 450 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909027:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38e:0x0].0x0 (00000000eb7ad866) 00010000:00010000:1.0:1776187966.909029:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x274:0x0].0x0 (000000005ec3a04a) 00010000:00010000:1.0:1776187966.909037:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.909037:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.909064:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439b74 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909064:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439b7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909079:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439b74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909079:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439b7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909088:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439b74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909088:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439b7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909100:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909100:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909107:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909107:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909113:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909113:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909218:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x274:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909218:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909232:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909233:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909239:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909248:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1776187966.909632:0:12471:0:(mdd_dir.c:1577:mdd_finish_unlink()) Object [0x200000401:0x38e:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1776187966.909673:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4722, 184 off830704 00000004:00010000:0.0:1776187966.909754:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d4e344b9 reply state 000000001b9d1a36 transno 4294975058 ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909766:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439b7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909772:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439b7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909782:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439b7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909788:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059094af5 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.909791:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439b7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909798:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439b7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909807:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:0.0:1776187966.909810:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.909813:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439b7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.909819:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439b7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.909828:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d4e344b9 reply state 000000001b9d1a36 transno 4294975058 ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.909862:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].422, 64 off35264 00000004:00080000:1.0:1776187966.909868:0:5516:0:(osp_sync.c:1658:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443893992448ns, next at 444893990618ns, rc = 0 00000040:00080000:1.0:1776187966.909900:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4723, 184 off830888 00010000:00010000:1.0:1776187966.909945:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x274:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909954:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909963:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909984:0:5516:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909990:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.909995:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.910016:0:5516:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187966.910018:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e344b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+451:11303:x1862467653403136:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1163us (2989us total) trans 4294975058 rc 0/0 00000004:00010000:1.0:1776187966.910025:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000090b78af5 reply state 000000005fce1c5d transno 4294975059 ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x274:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.910026:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15329 00010000:00010000:0.0:1776187966.910056:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.910061:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.910067:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439b74 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910067:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006aa2e88c already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.910070:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.910074:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439b74 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910076:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.910079:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439b74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.910083:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002adbeaf3 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.910084:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x274:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187966.910085:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439b74 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910086:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.910088:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.910090:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439b74 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910094:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee439b9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x274:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.910098:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x0 (00000000ed7fe374) 00010000:00010000:1.0:1776187966.910100:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.910102:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439b74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.910107:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439b74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910109:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.910110:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.910112:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1776187966.910115:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000090b78af5 reply state 000000005fce1c5d transno 4294975059 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.910125:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15331 00000100:00100000:0.0:1776187966.910130:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2d0ceec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+451:2224:x1862467653403200:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:0.0:1776187966.910142:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:1.0:1776187966.910145:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090b78af5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+451:11304:x1862467653403328:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1250us (2873us total) trans 4294975059 rc 0/0 00010000:00010000:0.0:1776187966.910152:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439ba5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caad3 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.910154:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15330 00010000:00010000:0.0:1776187966.910187:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439bac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910205:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439bac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910212:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439bac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910224:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910230:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910313:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910367:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439bba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910376:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910383:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1776187966.910405:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x38b:0x0]: returning size 15360 00000004:00200000:0.0:1776187966.910412:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187966.910424:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910437:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910446:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439bac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910452:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439bac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910458:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439bac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910465:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089ca4280 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.910467:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439bac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910474:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439bac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910486:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:0.0:1776187966.910489:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.910491:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439bac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910499:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439bac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910508:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910516:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910521:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910529:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.910531:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910536:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910544:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x57ca59f5 (000000004c664cf8) 00010000:00010000:0.0:1776187966.910546:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.910547:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439bb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910557:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439bb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910586:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439ba5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caad3 expref: 452 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910601:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439bba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caad3 expref: 451 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.910608:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38b:0x0].0x0 (000000003be36f4d) 00010000:00010000:0.0:1776187966.910610:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1776187966.910611:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000087802dc7, rc 0) 00000100:00100000:0.0:1776187966.910638:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2d0ceec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+451:2224:x1862467653403200:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 505us (3546us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187966.910644:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15331 00000100:00100000:3.0:1776187966.914685:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187966.914741:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653403456 00000100:00100000:2.0:1776187966.914797:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4453 00000100:00100000:2.0:1776187966.914803:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d12b55ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+451:11303:x1862467653403456:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.915076:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d12b55ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+452:11303:x1862467653403456:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 271us (400us total) trans 4294975060 rc 0/0 00000100:00100000:2.0:1776187966.915083:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4453 00010000:00010000:1.0:1776187966.915388:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915401:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915407:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915412:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.915416:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915424:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915439:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0xe364b611 (000000003d48dd25) 00010000:00010000:1.0:1776187966.915442:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.915446:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915453:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439b89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x272:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915472:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915477:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915482:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915487:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e3273a0 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.915489:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915495:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915502:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x274:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187966.915504:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.915506:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.915511:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439b97 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x274:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915574:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915583:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915588:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915593:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.915595:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915605:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915614:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x17610ee3 (000000000f84370d) 00010000:00010000:0.0:1776187966.915616:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.915618:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915623:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439b82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x17610ee3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915638:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915643:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915647:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915652:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000059fd37 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.915654:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915806:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915816:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38e:0x0].0x0 (00000000298f4138) 00010000:00010000:0.0:1776187966.915818:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.915820:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.915825:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439b90 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.918312:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.918480:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653403584 00000100:00100000:1.0:1776187966.918534:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15332 00000100:00100000:1.0:1776187966.918542:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+450:11303:x1862467653403584:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.918603:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.918627:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000033a084bb/0x92b1eb87ee43834f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x203:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca68f expref: 450 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.918647:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000283c650c/0x92b1eb87ee421bcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x203:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3221 expref: 449 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.918668:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000458ee653/0x92b1eb87ee421c34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x203:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c324b expref: 448 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.918679:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000483cb936/0x92b1eb87ee41dae8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x203:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1946 expref: 447 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.918688:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x203:0x0].0x0 (00000000814d9bd2) 00010000:00010000:1.0:1776187966.918696:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.918726:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439bc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.918741:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.918750:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.918763:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.918770:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.918775:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.919225:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x203:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.919236:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.919243:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187966.919692:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].424, 64 off35392 00000040:00080000:2.0:1776187966.919714:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4724, 184 off831072 00010000:00010000:2.0:1776187966.919777:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x203:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.919789:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.919797:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.919805:0:5517:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.919812:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.919818:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.919954:0:5517:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187966.920064:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000067f57eeb reply state 00000000f6796d6a transno 4294975061 ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x203:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.920111:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439bc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.920116:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439bc1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.920121:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439bc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.920127:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002adbeaf3 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187966.920130:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439bc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.920138:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439bc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.920148:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:2.0:1776187966.920151:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187966.920154:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439bc1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187966.920159:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee439bc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187966.920166:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000067f57eeb reply state 00000000f6796d6a transno 4294975061 ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.920308:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+448:11303:x1862467653403584:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1764us (2002us total) trans 4294975061 rc 0/0 00000100:00100000:2.0:1776187966.920319:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15332 00010000:00010000:1.0:1776187966.920566:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187966.920571:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.920583:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d81ab485 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187966.920586:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.920592:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.920601:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x203:0x0].0x0 (000000008d2350fb) 00010000:00010000:1.0:1776187966.920603:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187966.920604:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.920609:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439bd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x203:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401322432 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.920619:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.920621:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.920622:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.924507:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924528:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924535:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924541:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000550d135e already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.924546:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924553:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.924560:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187966.924569:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x4e78d319 (00000000f056c6a6) 00010000:00010000:0.0:1776187966.924573:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.924577:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924583:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000550d135e/0x92b1eb87ee439bc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x4e78d319 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924603:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924610:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924615:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924619:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e3273a0 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.924621:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924626:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.924627:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653403712 00010000:00010000:0.0:1776187966.924632:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x203:0x0].0x0 (000000008d2350fb) 00010000:00010000:0.0:1776187966.924634:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.924636:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.924641:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee439bcf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x203:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.924686:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15333 00000100:00100000:1.0:1776187966.924693:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb672dd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+447:11303:x1862467653403712:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.924758:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1776187966.924778:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000087802dc7/0x92b1eb87ee439bba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caad3 expref: 447 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.924792:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee438bec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca975 expref: 446 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.924805:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38b:0x0].0x0 (000000003be36f4d) 00010000:00010000:1.0:1776187966.924812:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.924841:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439bdd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.924857:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439bdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.924868:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439bdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.924914:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.924921:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.924927:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.925044:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.925052:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.925058:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1776187966.925391:0:5517:0:(mdd_dir.c:1577:mdd_finish_unlink()) Object [0x200000401:0x38b:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1776187966.925445:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4725, 184 off831256 00000004:00010000:1.0:1776187966.925534:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000fb672dd3 reply state 000000006836cd6d transno 4294975062 ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.925547:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439bdd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.925552:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439bdd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.925557:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439bdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.925562:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.925564:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439bdd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.925570:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439bdd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.925578:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:1.0:1776187966.925580:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.925582:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439bdd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.925587:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439bdd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.925600:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000fb672dd3 reply state 000000006836cd6d transno 4294975062 ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187966.925697:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb672dd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+447:11303:x1862467653403712:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1003us (1138us total) trans 4294975062 rc 0/0 00000100:00100000:1.0:1776187966.925708:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15333 00000100:00100000:0.0:1776187966.935343:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.935434:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1776187966.935444:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935461:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935469:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935476:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6dd5963 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.935481:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935494:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935513:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x57ca59f5 (000000007616c5c6) 00010000:00010000:1.0:1776187966.935517:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.935520:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935526:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439be4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x57ca59f5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935553:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935559:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935564:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935569:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.935571:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935577:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935583:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38b:0x0].0x0 (000000003d48dd25) 00010000:00010000:1.0:1776187966.935585:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.935587:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.935593:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439beb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187966.935683:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653403840 00000100:00100000:2.0:1776187966.935782:0:11799:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653403968 00000100:00100000:2.0:1776187966.935811:0:11799:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4454 00000100:00100000:2.0:1776187966.935818:0:11799:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e3c369 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+447:11303:x1862467653403840:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.936086:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4455 00000100:00100000:0.0:1776187966.936091:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f15623f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+448:11304:x1862467653403968:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187966.936156:0:11799:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e3c369 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+449:11303:x1862467653403840:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 338us (821us total) trans 4294975063 rc 0/0 00000100:00100000:2.0:1776187966.936164:0:11799:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4454 00000100:00100000:0.0:1776187966.936175:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f15623f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+449:11304:x1862467653403968:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 84us (742us total) trans 4294975064 rc 0/0 00000100:00100000:0.0:1776187966.936184:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4455 00000100:00100000:2.0:1776187966.941442:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.941605:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653404096 00000100:00100000:3.0:1776187966.941675:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15334 00000100:00100000:3.0:1776187966.941683:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003032ea0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+448:11304:x1862467653404096:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187966.941986:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187966.942022:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003af34d45/0x92b1eb87ee4385fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x276:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca776 expref: 448 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942047:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c6e3d3cb/0x92b1eb87ee42940d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x276:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5aa0 expref: 447 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942060:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008f01a848/0x92b1eb87ee42946f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x276:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5aca expref: 446 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942070:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e8e00e90/0x92b1eb87ee420910 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x276:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2bd0 expref: 445 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942086:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x276:0x0].0x0 (00000000b38cf413) 00010000:00010000:3.0:1776187966.942097:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187966.942133:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439bf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942149:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942158:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942170:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942176:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942182:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942304:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x276:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942313:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.942319:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187966.943238:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].423, 64 off35328 00000040:00080000:3.0:1776187966.943264:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4726, 184 off831440 00000100:00100000:3.0:1776187966.946114:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187966.947136:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x276:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947163:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947176:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947185:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947201:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947207:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947262:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187966.947292:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000003032ea0d reply state 0000000017f3f3ad transno 4294975065 ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x276:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947363:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947370:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439bf2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947381:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439bf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947386:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.947390:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439bf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947396:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439bf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947408:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x0 (00000000ed7fe374) 00010000:00010000:0.0:1776187966.947410:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.947414:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439bf2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.947419:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439bf2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x272:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.947429:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000003032ea0d reply state 0000000017f3f3ad transno 4294975065 ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.947524:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003032ea0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+446:11304:x1862467653404096:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 5839us (6089us total) trans 4294975065 rc 0/0 00000100:00100000:0.0:1776187966.947534:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15334 00000100:00100000:0.0:1776187966.947579:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653404224 00000100:00100000:0.0:1776187966.947629:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15335 00000100:00100000:0.0:1776187966.947635:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a482f139 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+446:11303:x1862467653404224:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.948092:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187966.948116:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c1c3d032/0x92b1eb87ee421fad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x208:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c335c expref: 446 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948135:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3211407/0x92b1eb87ee41dcee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x208:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a11 expref: 445 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948147:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009469333f/0x92b1eb87ee422016 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x208:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3386 expref: 444 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948157:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ae5a5c94/0x92b1eb87ee41dcbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x208:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a03 expref: 443 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948163:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x208:0x0].0x0 (000000000f8691a6) 00010000:00010000:0.0:1776187966.948172:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.948207:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948219:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948227:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948240:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948248:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948258:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948448:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x208:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948456:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.948462:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187966.954348:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].424, 64 off35392 00000040:00080000:0.0:1776187966.954378:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4727, 184 off831624 00010000:00010000:0.0:1776187966.954459:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x208:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.954480:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.954491:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.954500:0:5516:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.954506:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.954517:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.955613:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1776187966.955624:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.955637:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000059fd37 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187966.955642:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.955651:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.956321:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x276:0x0].0x0 (000000006882895f) 00010000:00010000:3.0:1776187966.956329:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187966.956347:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.956357:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000059fd37/0x92b1eb87ee439c07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x276:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.956536:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187966.956541:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.956549:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089ca4280 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187966.956553:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.956561:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.956571:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x208:0x0].0x0 (000000000f84370d) 00010000:00010000:1.0:1776187966.956573:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187966.956575:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.956584:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.956585:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187966.956588:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187966.956857:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.957640:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653404352 00000100:00100000:1.0:1776187966.957723:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4456 00000100:00100000:1.0:1776187966.957732:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001774e4d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+444:11304:x1862467653404352:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187966.958089:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001774e4d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+445:11304:x1862467653404352:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 356us (1236us total) trans 4294975067 rc 0/0 00000100:00100000:1.0:1776187966.958097:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4456 00010000:00010000:3.0:1776187966.958465:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958479:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958492:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958499:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000019adf367 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.958503:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958511:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958525:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x8b6dba3a (000000004e9c3dd8) 00010000:00010000:3.0:1776187966.958529:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.958532:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958539:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439bf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x272:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958559:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958566:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958571:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958576:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035ee1513 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.958578:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958584:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958591:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x276:0x0].0x0 (000000006882895f) 00010000:00010000:3.0:1776187966.958594:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.958596:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.958601:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x276:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.961992:0:5516:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1776187966.962010:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x208:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.962063:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a482f139 reply state 000000001e5f4a33 transno 4294975066 ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.962124:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.962131:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.962137:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.962143:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.962148:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.962154:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.962168:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:0.0:1776187966.962171:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.962175:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.962181:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x201:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187966.962189:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000a482f139 reply state 000000001e5f4a33 transno 4294975066 ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.962373:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187966.963469:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a482f139 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+444:11303:x1862467653404224:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 15826us (17355us total) trans 4294975066 rc 0/0 00000100:00100000:0.0:1776187966.963482:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15335 00000100:00100000:2.0:1776187966.963789:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.968865:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653404480 00000100:00100000:1.0:1776187966.968948:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15336 00000100:00100000:1.0:1776187966.968954:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca377c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+444:11304:x1862467653404480:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.969022:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187966.969048:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000039003fa0/0x92b1eb87ee4215ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3045 expref: 444 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969077:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c920fea0/0x92b1eb87ee41d6f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17b7 expref: 443 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969088:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000db70daa0/0x92b1eb87ee42161b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f9:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3053 expref: 442 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969098:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007960924c/0x92b1eb87ee41d6dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f9:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17b0 expref: 441 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969107:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f9:0x0].0x0 (00000000c5825219) 00010000:00010000:1.0:1776187966.969117:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.969147:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969163:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969172:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969185:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969200:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969207:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969325:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969583:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.969591:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187966.970135:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].425, 64 off35456 00000040:00080000:1.0:1776187966.970157:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4728, 184 off831808 00010000:00010000:1.0:1776187966.970238:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970250:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970259:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970266:0:5516:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970272:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970279:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970354:0:5516:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187966.970373:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ca377c44 reply state 0000000094dd5503 transno 4294975068 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970429:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970435:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970441:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970449:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.970453:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970460:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970471:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (00000000cf81227d) 00010000:00010000:1.0:1776187966.970474:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.970478:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.970484:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187966.970493:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ca377c44 reply state 0000000094dd5503 transno 4294975068 ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.972998:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187966.973011:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.973026:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e4a55c8f already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187966.973030:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.973039:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.973056:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f9:0x0].0x0 (000000007616c5c6) 00010000:00010000:0.0:1776187966.973059:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187966.973063:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.973069:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee439c3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.973096:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.973098:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187966.973099:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187966.975290:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca377c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+442:11304:x1862467653404480:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 6319us (11487us total) trans 4294975068 rc 0/0 00000100:00100000:1.0:1776187966.975309:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15336 00000100:00100000:3.0:1776187966.977406:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.977462:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187966.977501:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653404672 00000100:00100000:3.0:1776187966.977549:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15337 00000100:00100000:3.0:1776187966.977555:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b166f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+442:11400:x1862467653404672:12345-192.168.204.20@tcp:101:ll_sa_11303.0 00010000:00010000:3.0:1776187966.977579:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187966.977598:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439c46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x271:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caada expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.977632:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caada expref: 443 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.977645:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caada expref: 443 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.977653:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x0 (00000000e2a29158) 00010000:00010000:3.0:1776187966.977656:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.977660:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e57fe368, rc 0) 00000100:00100000:3.0:1776187966.977710:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b166f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+443:11400:x1862467653404672:12345-192.168.204.20@tcp:101:ll_sa_11303.0 Request processed in 155us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187966.977718:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15337 00000100:00100000:0.0:1776187966.982317:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653404608 00000100:00100000:0.0:1776187966.982412:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4457 00000100:00100000:0.0:1776187966.982419:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000140b6540 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+443:11303:x1862467653404608:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187966.982825:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000140b6540 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+444:11303:x1862467653404608:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 405us (5426us total) trans 4294975069 rc 0/0 00000100:00100000:0.0:1776187966.982833:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4457 00000100:00100000:2.0:1776187966.984633:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.985028:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653404800 00000100:00100000:0.0:1776187966.985079:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15338 00000100:00100000:0.0:1776187966.985086:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2a2bce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+444:11304:x1862467653404800:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187966.985140:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1776187966.985167:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ca6064ac/0x92b1eb87ee421079 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2e70 expref: 444 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985200:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003ba0c0fe/0x92b1eb87ee42105d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2e62 expref: 443 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985214:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001a0bc453/0x92b1eb87ee41d3a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1698 expref: 442 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985223:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (00000000994e3668) 00010000:00010000:0.0:1776187966.985234:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187966.985269:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985283:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985294:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985305:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985311:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985318:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985624:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439c5b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985632:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439c5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985640:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439c5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985861:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439c5b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985869:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439c5b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985907:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439c5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985914:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059094af5 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.985918:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439c5b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985925:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439c5b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985933:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (000000000f4996f9) 00010000:00010000:0.0:1776187966.985935:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187966.985938:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439c5b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985942:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439c5b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985958:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985963:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985969:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985973:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.985975:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.985981:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987068:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987085:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987091:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987096:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6dd5963 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.987099:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987106:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987120:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x8e4542d7 (000000003d48dd25) 00010000:00010000:3.0:1776187966.987122:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187966.987125:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987131:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee439c31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f3:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987147:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987153:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987158:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987163:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187966.987164:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987169:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987175:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f9:0x0].0x0 (000000007616c5c6) 00010000:00010000:3.0:1776187966.987177:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187966.987179:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187966.987183:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee439c38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.987509:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000004c664cf8) 00010000:00010000:0.0:1776187966.987511:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.987514:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.987520:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439c4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.987534:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.987539:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.987545:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.987550:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089ca4280 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187966.987552:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.987557:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.987564:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x12eaac0d (000000007f00126a) 00010000:00010000:0.0:1776187966.987566:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187966.987569:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187966.987574:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439c54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987835:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987844:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987849:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987854:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a152635 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.987856:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987862:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987871:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x8344d724 (00000000298f4138) 00010000:00010000:1.0:1776187966.987890:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187966.987893:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987898:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004a152635/0x92b1eb87ee439c15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x201:0x0].0x8344d724 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987913:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987919:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987924:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987929:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187966.987930:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987935:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987942:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x208:0x0].0x0 (000000000f84370d) 00010000:00010000:1.0:1776187966.987945:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187966.987946:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.987951:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000143824d6/0x92b1eb87ee439c1c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x208:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187966.988326:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2a2bce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+439:11304:x1862467653404800:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 3234us (3697us total) trans 0 rc -39/-39 00000100:00100000:0.0:1776187966.988348:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15338 00000100:00100000:0.0:1776187966.996738:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187966.998501:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187966.998811:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653404928 00000100:00100000:1.0:1776187966.998894:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15339 00000100:00100000:1.0:1776187966.998900:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ec4cfd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+439:11303:x1862467653404928:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187966.998963:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1776187966.999005:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee4382ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x277:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca65e expref: 439 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.999033:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c60b3fda/0x92b1eb87ee429644 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x277:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5b72 expref: 438 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.999047:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000448b9017/0x92b1eb87ee4296a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x277:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5b9c expref: 437 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.999062:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000206c7df8/0x92b1eb87ee4209bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x277:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c16 expref: 436 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.999073:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x277:0x0].0x0 (00000000f82506f0) 00010000:00010000:1.0:1776187966.999087:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006c5799fa/0x92b1eb87ee428ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x271:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c591f expref: 435 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.999094:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x0 (00000000e2a29158) 00010000:00010000:1.0:1776187966.999097:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187966.999131:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.999145:0:12471:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439c46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caada expref: 434 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.999153:0:12471:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.999187:0:12471:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caada expref: 434 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187966.999210:0:12471:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caada expref: 434 pid: 5516 timeout: 543 lvb_type: 0 00000100:00100000:1.0:1776187966.999224:0:12471:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a4c9a23 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12471:1862467659897216:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187966.999293:0:12471:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e141f268 going to sleep for 43 seconds 00000100:00100000:0.0:1776187967.002286:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187967.005070:0:12471:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a4c9a23 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:12471:1862467659897216:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187967.005103:0:12471:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187967.005267:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653404992 00000100:00100000:2.0:1776187967.005324:0:5519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653405120 00000100:00100000:2.0:1776187967.005414:0:5519:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4458 00000100:00100000:2.0:1776187967.005421:0:5519:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057505628 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11400:x1862467653404992:12345-192.168.204.20@tcp:37:ll_sa_11303.0 00000100:00100000:1.0:1776187967.007059:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4459 00000100:00100000:1.0:1776187967.007071:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d3cb9e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11304:x1862467653405120:12345-192.168.204.20@tcp:35:dbench.0 00000004:00080000:1.0:1776187967.007678:0:11766:0:(mdd_object.c:3529:mdd_close()) Object [0x200000401:0x204:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:3.0:1776187967.010316:0:5519:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057505628 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11400:x1862467653404992:12345-192.168.204.20@tcp:37:ll_sa_11303.0 Request processed in 4885us (11813us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187967.010512:0:5519:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4458 00000040:00080000:1.0:1776187967.015371:0:11766:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].425, 64 off35456 00000040:00080000:1.0:1776187967.015431:0:11766:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4729, 168 off831976 00000100:00100000:2.0:1776187967.015493:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.015595:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653405184 00010000:00010000:0.0:1776187967.015637:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caada expref: 436 pid: 5516 timeout: 543 lvb_type: 0 00000100:00100000:0.0:1776187967.015801:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4316 00000100:00100000:0.0:1776187967.015808:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b5b3a1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:2225:x1862467653405184:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1776187967.015822:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187967.015828:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caada expref: 436 pid: 5516 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187967.015841:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caada expref: 436 pid: 5516 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187967.015861:0:5502:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e57fe368/0x92b1eb87ee439c46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caada expref: 436 pid: 5516 timeout: 543 lvb_type: 0 00010000:00010000:0.0:1776187967.015907:0:5502:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x0 (00000000e2a29158) 00010000:00010000:0.0:1776187967.015914:0:5502:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.015926:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.015933:0:5502:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.015958:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187967.016096:0:12471:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.016106:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.016129:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.016139:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.016147:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.016285:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x277:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.016294:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.016301:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.016367:0:11766:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x204:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.016379:0:11766:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.016388:0:11766:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.016395:0:11766:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.016402:0:11766:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.016408:0:11766:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.016428:0:11766:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:3.0:1776187967.016735:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].426, 64 off35520 00000040:00080000:3.0:1776187967.016756:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4730, 184 off832160 00010000:00010000:3.0:1776187967.016806:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x277:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.016806:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d3cb9e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11304:x1862467653405120:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 9733us (14526us total) trans 4294975070 rc 0/0 00010000:00010000:3.0:1776187967.016823:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.016824:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4459 00010000:00010000:3.0:1776187967.016838:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.016845:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.016851:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.016857:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187967.017288:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b5b3a1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:2225:x1862467653405184:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 1478us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187967.017298:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4316 00010000:00010000:3.0:1776187967.017361:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00010000:3.0:1776187967.017381:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007ec4cfd3 reply state 000000008c858808 transno 4294975071 ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x277:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.017423:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.017430:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.017437:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.017443:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.017446:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.017459:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.017473:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x0 (00000000e2a29158) 00010000:00010000:3.0:1776187967.017476:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.017480:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.017485:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee439c62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187967.017496:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007ec4cfd3 reply state 000000008c858808 transno 4294975071 ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187967.017538:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ec4cfd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11303:x1862467653404928:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 18637us (20884us total) trans 4294975071 rc 0/0 00000100:00100000:3.0:1776187967.017545:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15339 00010000:00010000:1.0:1776187967.018826:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1776187967.018834:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.018846:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187967.018850:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.018858:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.018883:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x204:0x0].0x0 (00000000e5f011d9) 00010000:00010000:1.0:1776187967.018885:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187967.018889:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.018895:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439c77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x204:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.018923:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187967.018926:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.018931:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009372d704 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187967.018933:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.018944:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.018951:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x277:0x0].0x0 (000000004e9c3dd8) 00010000:00010000:1.0:1776187967.018953:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187967.018954:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.018959:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009372d704/0x92b1eb87ee439c7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x277:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.018967:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.018969:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.018970:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.018986:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.018987:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.018988:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187967.024070:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.024106:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.024383:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653405376 00000100:00100000:3.0:1776187967.024767:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653405248 00000100:00100000:3.0:1776187967.024804:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15340 00000100:00100000:3.0:1776187967.024812:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027970f29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11303:x1862467653405248:12345-192.168.204.20@tcp:101:dbench.0 00010000:00010000:3.0:1776187967.024848:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187967.024892:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439c85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caae1 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025066:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439c8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025086:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439c8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025098:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439c8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025111:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439c93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025117:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025122:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025245:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025268:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439c9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025268:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025289:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025290:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025305:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035ee1513 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.025308:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025310:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025325:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025340:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x8d5ea5b7 (000000006882895f) 00010000:00010000:1.0:1776187967.025344:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.025348:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025354:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee1513/0x92b1eb87ee439c69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x271:0x0].0x8d5ea5b7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187967.025362:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f1:0x0]: returning size 11776 00000004:00200000:3.0:1776187967.025367:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00010000:00010000:1.0:1776187967.025372:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025380:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025385:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025391:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000019adf367 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.025393:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025399:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187967.025400:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025411:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x277:0x0].0x0 (000000004e9c3dd8) 00010000:00010000:1.0:1776187967.025416:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187967.025417:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439c8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025419:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025434:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439c8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.025435:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000019adf367/0x92b1eb87ee439c70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x277:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025443:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439c8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025448:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000949deda1 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.025451:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439c8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025456:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439c8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025464:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (00000000866a3643) 00010000:00010000:3.0:1776187967.025466:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.025469:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439c8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025474:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439c8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025482:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439c93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025488:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439c93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025494:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025504:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000503e410b already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.025506:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439c93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025511:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439c93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025518:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x12eaac0d (00000000a528b82c) 00010000:00010000:3.0:1776187967.025520:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.025521:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439c93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025526:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439c93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025554:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439c85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caae1 expref: 439 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025570:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439c9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caae1 expref: 438 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.025577:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (0000000015f09a80) 00010000:00010000:3.0:1776187967.025580:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1776187967.025582:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000072a961c9, rc 0) 00000100:00100000:0.0:1776187967.025589:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4460 00000100:00100000:0.0:1776187967.025601:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffdb5047 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11304:x1862467653405376:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:3.0:1776187967.025676:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027970f29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11303:x1862467653405248:12345-192.168.204.20@tcp:101:dbench.0 Request processed in 863us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187967.025686:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15340 00000004:00080000:0.0:1776187967.025969:0:11766:0:(mdd_object.c:3529:mdd_close()) Object [0x200000401:0x38f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1776187967.026094:0:11766:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].426, 64 off35520 00000040:00080000:0.0:1776187967.026116:0:11766:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4731, 168 off832328 00010000:00010000:0.0:1776187967.027586:0:11766:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.027606:0:11766:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.027618:0:11766:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.027626:0:11766:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.027632:0:11766:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.027638:0:11766:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.027660:0:11766:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187967.027815:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ffdb5047 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11304:x1862467653405376:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 2213us (3707us total) trans 4294975072 rc 0/0 00000100:00100000:0.0:1776187967.027825:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4460 00010000:00010000:1.0:1776187967.027952:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187967.027957:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.027965:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089ca4280 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187967.027969:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.027976:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.027987:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38f:0x0].0x0 (000000007f00126a) 00010000:00010000:1.0:1776187967.027990:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187967.027994:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.028000:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089ca4280/0x92b1eb87ee439ca1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634309361408128 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11766 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.028016:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.028017:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.028019:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187967.032716:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.032802:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653405504 00000100:00100000:0.0:1776187967.032858:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4461 00000100:00100000:0.0:1776187967.032865:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000102a405b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11303:x1862467653405504:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:0.0:1776187967.033284:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000102a405b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11303:x1862467653405504:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 418us (574us total) trans 4294975073 rc 0/0 00000100:00100000:0.0:1776187967.033293:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4461 00000100:00100000:2.0:1776187967.039445:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.039578:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653405632 00000100:00100000:1.0:1776187967.039648:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15341 00000100:00100000:1.0:1776187967.039655:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001774e4d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11303:x1862467653405632:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187967.039724:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187967.039755:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000040a5a5f/0x92b1eb87ee438276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x273:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca642 expref: 438 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.039779:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000079e42234/0x92b1eb87ee42917b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x273:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c59ab expref: 437 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.039793:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000010336250/0x92b1eb87ee4291c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x273:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c59c7 expref: 436 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.039804:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000056b3fb28/0x92b1eb87ee4207dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x273:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b60 expref: 435 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.039813:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x273:0x0].0x0 (000000007976a568) 00010000:00010000:1.0:1776187967.039823:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187967.039859:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439ca8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.039918:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439ca8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.039930:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439ca8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.039946:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.039952:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.039963:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.040077:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x273:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.040086:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.040092:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187967.040768:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].427, 64 off35584 00000040:00080000:1.0:1776187967.040794:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4732, 184 off832512 00010000:00010000:1.0:1776187967.040861:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x273:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.040910:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.040921:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.040928:0:5516:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.040935:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.040946:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.040981:0:5516:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187967.041007:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001774e4d8 reply state 000000001795ee67 transno 4294975074 ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x273:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.041066:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439ca8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.041073:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439ca8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.041079:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439ca8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.041087:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dce30c64 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.041091:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439ca8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.041099:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439ca8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.041111:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x0 (00000000e2a29158) 00010000:00010000:1.0:1776187967.041114:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.041117:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439ca8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.041124:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439ca8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.041310:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187967.041317:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.041329:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c48750ea already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187967.041332:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.041337:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.041347:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x273:0x0].0x0 (000000006c0357c0) 00010000:00010000:2.0:1776187967.041349:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187967.041351:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.041356:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee439cbd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x273:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.041369:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187967.041370:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187967.041372:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1776187967.044577:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000001774e4d8 reply state 000000001795ee67 transno 4294975074 ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.044759:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001774e4d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11303:x1862467653405632:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 5100us (5319us total) trans 4294975074 rc 0/0 00000100:00100000:1.0:1776187967.044771:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15341 00010000:00010000:3.0:1776187967.055795:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055819:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055827:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055833:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0ab918b already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.055838:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055846:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055865:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0xe364b611 (00000000194664fe) 00010000:00010000:3.0:1776187967.055868:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.055907:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055915:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee439caf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x271:0x0].0xe364b611 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055941:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055947:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055953:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055958:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000474fd8b4 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.055960:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055977:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055986:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x273:0x0].0x0 (000000006c0357c0) 00010000:00010000:3.0:1776187967.055988:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187967.055990:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.055995:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee439cb6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x273:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187967.061413:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.062307:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653405760 00000100:00100000:1.0:1776187967.062692:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4462 00000100:00100000:1.0:1776187967.062703:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11303:x1862467653405760:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187967.063262:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11303:x1862467653405760:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 558us (1858us total) trans 4294975075 rc 0/0 00000100:00100000:1.0:1776187967.063271:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4462 00000100:00100000:1.0:1776187967.066927:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.067038:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653405888 00000100:00100000:0.0:1776187967.067097:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15342 00000100:00100000:0.0:1776187967.067105:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000261b4fd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11303:x1862467653405888:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:0.0:1776187967.067173:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187967.067215:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee438299 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x275:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca650 expref: 436 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067242:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000013dc3117/0x92b1eb87ee429326 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x275:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5a4c expref: 435 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067266:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f89fadee/0x92b1eb87ee429396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x275:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5a76 expref: 434 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067277:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ab449f1e/0x92b1eb87ee4208d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x275:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2bc2 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067286:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x275:0x0].0x0 (000000000ae0634a) 00010000:00010000:0.0:1776187967.067299:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187967.067347:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439cc4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067365:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067375:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067389:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067394:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067400:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067521:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x275:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067533:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x275:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.067540:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x275:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187967.068034:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].428, 64 off35648 00000040:00080000:0.0:1776187967.068057:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4733, 184 off832696 00010000:00010000:0.0:1776187967.068133:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x275:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068146:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x275:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068155:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x275:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068162:0:5516:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x275:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068168:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x275:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068174:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x275:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068200:0:5516:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:0.0:1776187967.068219:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000261b4fd0 reply state 00000000218d22d0 transno 4294975076 ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x275:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068281:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439cc4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068288:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439cc4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068293:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439cc4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068300:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187967.068304:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439cc4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068312:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439cc4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068323:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x0 (00000000e2a29158) 00010000:00010000:0.0:1776187967.068326:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187967.068329:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439cc4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.068335:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439cc4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x271:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187967.068343:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000261b4fd0 reply state 00000000218d22d0 transno 4294975076 ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187967.068443:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000261b4fd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11303:x1862467653405888:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1335us (1565us total) trans 4294975076 rc 0/0 00000100:00100000:0.0:1776187967.068456:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15342 00010000:00010000:1.0:1776187967.068995:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187967.069001:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x275:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.069009:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e168beb already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187967.069011:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x275:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.069017:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x275:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.069027:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x275:0x0].0x0 (000000000f4996f9) 00010000:00010000:1.0:1776187967.069029:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187967.069032:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x275:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.069037:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee439cd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x275:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.069048:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.069050:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.069051:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.075730:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075754:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075761:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075768:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059094af5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.075772:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075778:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075795:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x8b6dba3a (000000004c664cf8) 00010000:00010000:1.0:1776187967.075798:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.075802:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075807:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000059094af5/0x92b1eb87ee439ccb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x271:0x0].0x8b6dba3a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075830:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x275:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075836:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x275:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075841:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x275:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075846:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005f47f5e7 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.075848:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x275:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075852:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x275:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075859:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x275:0x0].0x0 (000000000f4996f9) 00010000:00010000:1.0:1776187967.075862:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187967.075864:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x275:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.075868:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee439cd2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x275:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.077507:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.077645:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653406016 00000100:00100000:2.0:1776187967.077712:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4463 00000100:00100000:2.0:1776187967.077719:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db4ef2c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11303:x1862467653406016:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187967.078197:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db4ef2c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11303:x1862467653406016:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 467us (688us total) trans 4294975077 rc 0/0 00000100:00100000:2.0:1776187967.078205:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4463 00000100:00100000:2.0:1776187967.084503:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.084557:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.084633:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.084852:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653406208 00000100:00100000:0.0:1776187967.084957:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653406144 00000100:00100000:0.0:1776187967.085001:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:0.0:1776187967.085008:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef5c0c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+90:2222:x1862467653406208:12345-192.168.204.20@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1776187967.085117:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef5c0c7d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+90:2222:x1862467653406208:12345-192.168.204.20@tcp:400:kworker/u8:2.0 Request processed in 108us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187967.085126:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 120 00000100:00100000:0.0:1776187967.085149:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:0.0:1776187967.085153:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+71:2222:x1862467653406144:12345-192.168.204.20@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1776187967.085179:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+71:2222:x1862467653406144:12345-192.168.204.20@tcp:400:kworker/u8:2.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187967.085186:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 121 00000100:00100000:3.0:1776187967.086682:0:5509:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653406080 00000100:00100000:3.0:1776187967.086750:0:5509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 298 00000100:00100000:3.0:1776187967.086757:0:5509:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a795bbab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2ae673b-89a8-4483-906b-6087e209f7f4+9:2222:x1862467653406080:12345-192.168.204.20@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1776187967.086960:0:5509:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a795bbab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2ae673b-89a8-4483-906b-6087e209f7f4+9:2222:x1862467653406080:12345-192.168.204.20@tcp:400:kworker/u8:2.0 Request processed in 201us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187967.086979:0:5509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 298 00000100:00100000:1.0:1776187967.093338:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187967.093449:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653406336 00000100:00100000:3.0:1776187967.093518:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15343 00000100:00100000:3.0:1776187967.093525:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000965161d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11303:x1862467653406336:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:3.0:1776187967.093595:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187967.093635:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009ea3d7ec/0x92b1eb87ee42164c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fa:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3061 expref: 434 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.093678:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000058aec397/0x92b1eb87ee41d722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17c5 expref: 433 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.093693:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000885c72d0/0x92b1eb87ee42166f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1fa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c306f expref: 432 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.093706:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a238212a/0x92b1eb87ee41d70d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1fa:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17be expref: 431 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.093716:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fa:0x0].0x0 (0000000085b3cef4) 00010000:00010000:3.0:1776187967.093728:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187967.093762:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439ce0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.093779:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439ce0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.093790:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439ce0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.093805:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.093812:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.093818:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094020:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094029:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094037:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187967.094459:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].427, 64 off35584 00000040:00080000:3.0:1776187967.094479:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4734, 184 off832880 00010000:00010000:3.0:1776187967.094540:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094550:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094558:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094566:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094573:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094578:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094596:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:3.0:1776187967.094613:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000965161d5 reply state 00000000e982fe3e transno 4294975078 ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094680:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439ce0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094687:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439ce0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094693:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439ce0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094699:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.094703:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439ce0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094710:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439ce0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094720:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (00000000b347ce5e) 00010000:00010000:3.0:1776187967.094723:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.094726:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439ce0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.094732:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439ce0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187967.094740:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000965161d5 reply state 00000000e982fe3e transno 4294975078 ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187967.094993:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000965161d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11303:x1862467653406336:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1465us (1670us total) trans 4294975078 rc 0/0 00000100:00100000:3.0:1776187967.095003:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15343 00010000:00010000:1.0:1776187967.095699:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187967.095705:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.095721:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ec6f9d6a already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187967.095724:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.095731:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.095742:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fa:0x0].0x0 (00000000a528b82c) 00010000:00010000:1.0:1776187967.095744:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187967.095747:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.095752:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ec6f9d6a/0x92b1eb87ee439cf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.095765:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.095766:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.095768:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187967.098683:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098703:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098710:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098716:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000503e410b already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.098720:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098726:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098741:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x8e4542d7 (00000000866a3643) 00010000:00010000:3.0:1776187967.098744:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.098749:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098755:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439ce7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0x8e4542d7 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098785:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098791:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098796:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098802:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000949deda1 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.098804:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098808:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098815:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fa:0x0].0x0 (00000000a528b82c) 00010000:00010000:3.0:1776187967.098817:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187967.098819:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.098824:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439cee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.106387:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.106858:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653406464 00000100:00100000:2.0:1776187967.106935:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4464 00000100:00100000:2.0:1776187967.106942:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebd005c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+431:11303:x1862467653406464:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187967.107184:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebd005c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11303:x1862467653406464:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 242us (807us total) trans 4294975079 rc 0/0 00000100:00100000:2.0:1776187967.107204:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4464 00000100:00100000:2.0:1776187967.109807:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.118200:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653406592 00000100:00100000:1.0:1776187967.118547:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15344 00000100:00100000:1.0:1776187967.118556:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffdb5047 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11303:x1862467653406592:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187967.118627:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187967.118665:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005b759804/0x92b1eb87ee421756 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c30b5 expref: 432 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.118691:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eee09744/0x92b1eb87ee41d879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1fd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c185f expref: 431 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.118708:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dba0bed1/0x92b1eb87ee421779 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1fd:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c30c3 expref: 430 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.118718:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000384217ec/0x92b1eb87ee41d864 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1fd:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1851 expref: 429 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.118728:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fd:0x0].0x0 (00000000eb10c218) 00010000:00010000:1.0:1776187967.118741:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187967.118794:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439cfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.118811:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439cfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.118821:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439cfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.118836:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.118844:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.118855:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119042:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119055:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119062:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187967.119466:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].429, 64 off35712 00000040:00080000:1.0:1776187967.119490:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4735, 184 off833064 00010000:00010000:1.0:1776187967.119554:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119564:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119573:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119582:0:5516:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119587:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119593:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119848:0:5516:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187967.119871:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ffdb5047 reply state 000000008b39393c transno 4294975080 ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119947:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439cfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119954:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439cfc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119960:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439cfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119966:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dce30c64 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.119969:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439cfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119976:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439cfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.119989:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (00000000b347ce5e) 00010000:00010000:1.0:1776187967.119992:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.119995:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439cfc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.120000:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439cfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187967.120010:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000ffdb5047 reply state 000000008b39393c transno 4294975080 ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.120096:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ffdb5047 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+430:11303:x1862467653406592:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1538us (10303us total) trans 4294975080 rc 0/0 00000100:00100000:1.0:1776187967.120108:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15344 00010000:00010000:0.0:1776187967.120712:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187967.120718:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.120728:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187967.120731:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.120738:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.120748:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fd:0x0].0x0 (000000007842f307) 00010000:00010000:0.0:1776187967.120751:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187967.120753:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.120758:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee439d11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1fd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.120954:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187967.120955:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187967.120957:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.123636:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123656:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123662:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123668:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.123672:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123679:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123694:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0xe93b25ce (00000000e5f011d9) 00010000:00010000:1.0:1776187967.123697:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.123701:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123706:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0xe93b25ce bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123729:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123735:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123742:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123747:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d26d87db already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.123749:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123754:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123761:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1fd:0x0].0x0 (000000007842f307) 00010000:00010000:1.0:1776187967.123763:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187967.123777:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.123782:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187967.127296:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.127379:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653406720 00000100:00100000:1.0:1776187967.127437:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4465 00000100:00100000:1.0:1776187967.127443:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000102a405b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+429:11303:x1862467653406720:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187967.127696:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000102a405b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+430:11303:x1862467653406720:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 251us (410us total) trans 4294975081 rc 0/0 00000100:00100000:1.0:1776187967.127704:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4465 00000100:00100000:3.0:1776187967.131379:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.131477:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653406848 00000100:00100000:1.0:1776187967.131537:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15345 00000100:00100000:1.0:1776187967.131544:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d12b55ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+430:11303:x1862467653406848:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187967.131629:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187967.131661:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008fc6b2b4/0x92b1eb87ee42186e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ff:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3109 expref: 430 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.131688:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f5ab6baf/0x92b1eb87ee41d960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ff:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18ba expref: 429 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.131700:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002469e01a/0x92b1eb87ee4218d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ff:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c312c expref: 428 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.131711:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003513b385/0x92b1eb87ee41d928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ff:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18ac expref: 427 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.131720:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ff:0x0].0x0 (000000003534518b) 00010000:00010000:1.0:1776187967.131732:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187967.131761:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d18 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.131775:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.131786:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.131802:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.131808:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.131818:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132072:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132080:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132086:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187967.132475:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].430, 64 off35776 00000040:00080000:1.0:1776187967.132499:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4736, 184 off833248 00010000:00010000:1.0:1776187967.132558:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132568:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132576:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132583:0:5516:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132589:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132600:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634308401326528 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132666:0:5516:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187967.132684:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d12b55ab reply state 000000009b0c2555 transno 4294975082 ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132730:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d18 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132736:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d18 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132743:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d18 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132749:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.132755:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d18 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132762:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d18 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132771:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (00000000b347ce5e) 00010000:00010000:1.0:1776187967.132774:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.132778:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d18 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.132783:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d18 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187967.132793:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000d12b55ab reply state 000000009b0c2555 transno 4294975082 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.132902:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d12b55ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+428:11303:x1862467653406848:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1356us (1530us total) trans 4294975082 rc 0/0 00000100:00100000:1.0:1776187967.132910:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15345 00010000:00010000:0.0:1776187967.135133:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135152:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135159:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135164:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4841773 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187967.135168:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135176:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135199:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0xe2501d74 (00000000f54f0a62) 00010000:00010000:0.0:1776187967.135202:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187967.135206:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135217:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee439d1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0xe2501d74 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135237:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135243:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135248:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135254:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dce30c64 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187967.135255:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135260:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135266:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ff:0x0].0x0 (000000006c0357c0) 00010000:00010000:0.0:1776187967.135268:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187967.135270:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.135274:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee439d26 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1ff:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.140307:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187967.140321:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.140338:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cea3a6c8 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187967.140341:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308401326528 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.140351:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308401326528 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.140864:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ff:0x0].0x0 (000000006c0357c0) 00010000:00010000:2.0:1776187967.140868:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187967.140908:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.140916:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439d2d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ff:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308401326528 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.140966:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187967.140968:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187967.140970:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187967.142109:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.142526:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653406976 00000100:00100000:2.0:1776187967.142582:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4466 00000100:00100000:2.0:1776187967.142588:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000140b6540 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+427:11303:x1862467653406976:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187967.143058:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000140b6540 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+428:11303:x1862467653406976:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 468us (958us total) trans 4294975083 rc 0/0 00000100:00100000:2.0:1776187967.143067:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4466 00000100:00100000:3.0:1776187967.148707:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.148990:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653407104 00000100:00100000:1.0:1776187967.149048:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15346 00000100:00100000:1.0:1776187967.149054:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3e3c369 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+428:11303:x1862467653407104:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187967.149112:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187967.149144:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000091858da3/0x92b1eb87ee4214fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f8:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2fea expref: 428 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149165:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000fd02650c/0x92b1eb87ee41d66c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c177f expref: 427 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149176:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a5429176/0x92b1eb87ee421596 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f8:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3029 expref: 426 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149197:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c815022e/0x92b1eb87ee41d650 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1771 expref: 425 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149208:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f8:0x0].0x0 (00000000bb7d7d0a) 00010000:00010000:1.0:1776187967.149218:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187967.149253:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149273:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149282:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149295:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149301:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149307:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149424:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149431:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.149437:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187967.150331:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].428, 64 off35648 00000040:00080000:1.0:1776187967.150367:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4737, 184 off833432 00010000:00010000:1.0:1776187967.150462:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150478:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150490:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150499:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150505:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150511:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150637:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187967.150664:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e3e3c369 reply state 00000000fe9a0164 transno 4294975084 ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150723:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150730:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150737:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150744:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.150748:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150760:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150774:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (00000000b347ce5e) 00010000:00010000:1.0:1776187967.150777:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.150783:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.150789:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187967.150810:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000e3e3c369 reply state 00000000fe9a0164 transno 4294975084 ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.150994:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3e3c369 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+426:11303:x1862467653407104:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 1936us (2295us total) trans 4294975084 rc 0/0 00000100:00100000:1.0:1776187967.151005:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15346 00010000:00010000:2.0:1776187967.151393:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187967.151398:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.151406:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d719b35a already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187967.151409:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.151415:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.151425:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f8:0x0].0x0 (00000000e5f011d9) 00010000:00010000:2.0:1776187967.151427:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187967.151429:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.151435:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439d49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.151453:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187967.151454:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187967.151455:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187967.155232:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155254:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155263:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155270:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d26d87db already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.155274:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155282:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155302:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0xbf0c4e99 (000000007842f307) 00010000:00010000:1.0:1776187967.155305:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.155310:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155316:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439d3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0xbf0c4e99 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155344:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155350:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155354:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155358:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.155360:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155365:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155370:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f8:0x0].0x0 (00000000e5f011d9) 00010000:00010000:1.0:1776187967.155373:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187967.155375:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.155380:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439d42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187967.160227:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.160443:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653407232 00000100:00100000:1.0:1776187967.160520:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15347 00000100:00100000:1.0:1776187967.160528:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f15623f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+425:11303:x1862467653407232:12345-192.168.204.20@tcp:36:dbench.0 00010000:00010000:1.0:1776187967.160592:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187967.160633:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000072a961c9/0x92b1eb87ee439c9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caae1 expref: 425 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.160655:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (0000000015f09a80) 00010000:00010000:1.0:1776187967.160668:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187967.160714:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.160730:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.160739:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.160750:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.160755:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.160765:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162055:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439d5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162074:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439d5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162083:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439d5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162160:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439d5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162168:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439d5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162174:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439d5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162180:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.162184:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439d5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162203:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439d5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162214:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (000000003d48dd25) 00010000:00010000:1.0:1776187967.162281:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187967.162286:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439d5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162292:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439d5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162320:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162326:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162332:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162337:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.162340:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162345:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162353:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (00000000194664fe) 00010000:00010000:1.0:1776187967.162355:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.162357:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d50 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162362:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162379:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162384:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162389:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162393:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.162395:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162400:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162406:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x12eaac0d (000000007616c5c6) 00010000:00010000:1.0:1776187967.162408:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.162410:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.162415:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.162630:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f15623f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+424:11303:x1862467653407232:12345-192.168.204.20@tcp:36:dbench.0 Request processed in 2098us (2410us total) trans 0 rc -39/-39 00000100:00100000:1.0:1776187967.162641:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15347 00000100:00100000:0.0:1776187967.171923:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.171978:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653407360 00000100:00100000:2.0:1776187967.172027:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4467 00000100:00100000:2.0:1776187967.172034:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bead27ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+424:11303:x1862467653407360:12345-192.168.204.20@tcp:35:dbench.0 00000004:00080000:2.0:1776187967.172398:0:5518:0:(mdd_object.c:3529:mdd_close()) Object [0x200000401:0x38e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1776187967.172472:0:5518:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].429, 64 off35712 00000040:00080000:2.0:1776187967.172492:0:5518:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4738, 168 off833600 00010000:00010000:2.0:1776187967.172573:0:5518:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.172591:0:5518:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.172603:0:5518:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.172611:0:5518:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.172616:0:5518:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.172622:0:5518:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.172806:0:5518:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187967.173001:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bead27ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+425:11303:x1862467653407360:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 963us (1084us total) trans 4294975085 rc 0/0 00000100:00100000:2.0:1776187967.173010:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4467 00010000:00010000:0.0:1776187967.173381:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187967.173386:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.173395:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187967.173398:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.173406:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.173420:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38e:0x0].0x0 (0000000063901265) 00010000:00010000:0.0:1776187967.173423:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187967.173427:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.173432:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439d65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.173450:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187967.173452:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187967.173453:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187967.176281:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.178430:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653407488 00000100:00100000:2.0:1776187967.178490:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4468 00000100:00100000:2.0:1776187967.178498:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000033b3298 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+425:11303:x1862467653407488:12345-192.168.204.20@tcp:35:dbench.0 00000004:00080000:2.0:1776187967.180679:0:5518:0:(mdd_object.c:3529:mdd_close()) Object [0x200000401:0x38b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1776187967.181518:0:5518:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].431, 64 off35840 00000040:00080000:3.0:1776187967.181560:0:5518:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4739, 168 off833768 00010000:00010000:3.0:1776187967.181669:0:5518:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.181702:0:5518:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.181715:0:5518:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.181723:0:5518:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.181729:0:5518:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.181735:0:5518:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.181762:0:5518:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1776187967.182106:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000033b3298 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+426:11303:x1862467653407488:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 3605us (5832us total) trans 4294975086 rc 0/0 00000100:00100000:3.0:1776187967.182118:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4468 00010000:00010000:2.0:1776187967.182312:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187967.182318:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.182329:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000949deda1 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187967.182333:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.182341:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.182355:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38b:0x0].0x0 (00000000a528b82c) 00010000:00010000:2.0:1776187967.182367:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187967.182372:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.182378:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000949deda1/0x92b1eb87ee439d6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT gid 18446634308842301568 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 5518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.182393:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187967.182395:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187967.182618:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187967.190761:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.191061:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653407616 00000100:00100000:1.0:1776187967.191141:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4469 00000100:00100000:1.0:1776187967.191163:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed9b3b81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+426:11302:x1862467653407616:12345-192.168.204.20@tcp:35:dbench.0 00000001:00080000:1.0:1776187967.191609:0:5518:0:(tgt_lastrcvd.c:2004:tgt_txn_stop_cb()) More than one transaction 4294975087 00000100:00100000:1.0:1776187967.191726:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed9b3b81 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+427:11302:x1862467653407616:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 561us (974us total) trans 4294975087 rc 0/0 00000100:00100000:1.0:1776187967.191736:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4469 00000100:00100000:3.0:1776187967.197640:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.198179:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653407744 00000100:00100000:2.0:1776187967.198254:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4470 00000100:00100000:2.0:1776187967.198261:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006cc0212f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+427:11302:x1862467653407744:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187967.198548:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006cc0212f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+428:11302:x1862467653407744:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 286us (917us total) trans 4294975088 rc 0/0 00000100:00100000:2.0:1776187967.198556:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4470 00000100:00100000:3.0:1776187967.210147:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.210353:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653407872 00000100:00100000:1.0:1776187967.210407:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4471 00000100:00100000:1.0:1776187967.210414:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000812af665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+428:11302:x1862467653407872:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187967.210635:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000812af665 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+429:11302:x1862467653407872:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 221us (497us total) trans 4294975089 rc 0/0 00000100:00100000:1.0:1776187967.210643:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4471 00000100:00100000:3.0:1776187967.216313:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.216635:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408000 00000100:00100000:2.0:1776187967.216684:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4472 00000100:00100000:2.0:1776187967.216690:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012c0d89e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+429:11302:x1862467653408000:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:2.0:1776187967.216971:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012c0d89e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+430:11302:x1862467653408000:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 280us (666us total) trans 4294975090 rc 0/0 00000100:00100000:2.0:1776187967.216979:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4472 00000100:00100000:3.0:1776187967.222926:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.223088:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408128 00000100:00100000:1.0:1776187967.223143:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4473 00000100:00100000:1.0:1776187967.223150:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024f833d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+430:11302:x1862467653408128:12345-192.168.204.20@tcp:35:dbench.0 00000100:00100000:1.0:1776187967.223399:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024f833d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+431:11302:x1862467653408128:12345-192.168.204.20@tcp:35:dbench.0 Request processed in 247us (484us total) trans 4294975091 rc 0/0 00000100:00100000:1.0:1776187967.223407:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4473 00000100:00100000:3.0:1776187967.237576:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.237846:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408192 00000100:00100000:1.0:1776187967.237950:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15348 00000100:00100000:1.0:1776187967.237958:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000033b3298 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+431:11403:x1862467653408192:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1776187967.237986:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.238009:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caae8 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.238357:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.238373:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.238384:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1776187967.238446:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1ea:0x0]: returning size 11776 00000004:00200000:1.0:1776187967.238450:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1776187967.238470:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.238495:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439d73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caae8 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.238511:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caae8 expref: 432 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.238519:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.238522:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1776187967.238525:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b3067c2f, rc 0) 00000100:00100000:1.0:1776187967.238581:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000033b3298 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11403:x1862467653408192:12345-192.168.204.20@tcp:101:bash.0 Request processed in 624us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187967.238597:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15348 00000100:00100000:1.0:1776187967.244973:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187967.245260:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408256 00000100:00100000:3.0:1776187967.245319:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15349 00000100:00100000:3.0:1776187967.245327:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e72b87f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11403:x1862467653408256:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:3.0:1776187967.245349:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187967.245384:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439d81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caaef expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245456:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439d88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245471:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245482:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245496:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439d8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x3ae3d5f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245504:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3ae3d5f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245509:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3ae3d5f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245581:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439d88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245588:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439d88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245593:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439d88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245599:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.245602:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439d88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245608:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439d88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245619:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:3.0:1776187967.245622:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.245626:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439d88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245631:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439d88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245641:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439d8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3ae3d5f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245646:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439d8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3ae3d5f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245650:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3ae3d5f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245655:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000900c220d already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.245656:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439d8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3ae3d5f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245662:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439d8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3ae3d5f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245669:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x3ae3d5f0 (00000000866a3643) 00010000:00010000:3.0:1776187967.245671:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.245673:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439d8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x3ae3d5f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245678:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439d8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x3ae3d5f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245707:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439d81 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaef expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245715:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439d81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaef expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.245722:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000503e410b, rc 0) 00000100:00100000:3.0:1776187967.245787:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e72b87f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11403:x1862467653408256:12345-192.168.204.20@tcp:101:bash.0 Request processed in 459us (820us total) trans 0 rc 301/301 00000100:00100000:3.0:1776187967.245794:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15349 00000100:00100000:3.0:1776187967.277668:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.277810:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408320 00000100:00100000:2.0:1776187967.277870:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15350 00000100:00100000:2.0:1776187967.277922:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed9b3b81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11404:x1862467653408320:12345-192.168.204.20@tcp:101:date.0 00010000:00010000:2.0:1776187967.277952:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.277981:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439d96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caaf6 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278057:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439d9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278074:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439d9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278085:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439d9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278102:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439da4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xeddcfc6c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278108:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278113:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278218:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439d9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278225:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439d9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278232:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439d9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278237:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000597b6781 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.278240:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439d9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278246:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439d9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278259:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187967.278261:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.278266:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439d9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278275:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439d9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278289:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278296:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439da4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278301:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278306:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.278308:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278313:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278319:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0xeddcfc6c (0000000063901265) 00010000:00010000:2.0:1776187967.278321:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.278322:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439da4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278328:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439da4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xeddcfc6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278365:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439d96 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaf6 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278378:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439d96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caaf6 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.278387:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000791f3e8c, rc 0) 00000100:00100000:2.0:1776187967.278456:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed9b3b81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11404:x1862467653408320:12345-192.168.204.20@tcp:101:date.0 Request processed in 534us (810us total) trans 0 rc 301/301 00000100:00100000:2.0:1776187967.278464:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15350 00000100:00100000:1.0:1776187967.281568:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187967.281681:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408384 00000100:00100000:3.0:1776187967.281736:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15351 00000100:00100000:3.0:1776187967.281743:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c90e0dec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11404:x1862467653408384:12345-192.168.204.20@tcp:101:date.0 00010000:00010000:3.0:1776187967.281767:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187967.281795:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439dab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caafd expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.281865:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439db2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282103:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282119:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282136:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439db9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x3491cd4c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282142:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282147:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282237:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439db2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282246:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439db2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282253:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282259:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000900c220d already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.282263:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439db2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282269:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439db2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282281:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:3.0:1776187967.282284:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.282288:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439db2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282293:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee439db2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282306:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439db9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282311:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439db9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282315:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282320:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.282331:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439db9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282336:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439db9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282343:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x3491cd4c (00000000866a3643) 00010000:00010000:3.0:1776187967.282345:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.282347:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439db9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282357:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee439db9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x3491cd4c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282389:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439dab lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caafd expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282397:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee439dab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caafd expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.282405:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000503e410b, rc 0) 00000100:00100000:3.0:1776187967.282470:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c90e0dec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11404:x1862467653408384:12345-192.168.204.20@tcp:101:date.0 Request processed in 727us (910us total) trans 0 rc 301/301 00000100:00100000:3.0:1776187967.282478:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15351 00000100:00100000:0.0:1776187967.295962:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187967.302544:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408448 00000100:00100000:2.0:1776187967.302920:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15352 00000100:00100000:2.0:1776187967.302928:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061378dda pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11404:x1862467653408448:12345-192.168.204.20@tcp:101:date.0 00010000:00010000:2.0:1776187967.302951:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.302974:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439dc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab04 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303036:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439dc7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303051:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303063:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303078:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x3735a305 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303086:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303099:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303174:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439dc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303182:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439dc7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303200:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303207:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.303211:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303218:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439dc7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303229:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187967.303231:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.303235:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439dc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303241:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439dc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303253:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303264:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439dce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303270:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303275:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000597b6781 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.303277:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303283:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439dce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303291:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x3735a305 (0000000063901265) 00010000:00010000:2.0:1776187967.303293:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.303295:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439dce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.303301:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x3735a305 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.304598:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439dc0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab04 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.304614:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439dc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab04 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.304628:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000791f3e8c, rc 0) 00000100:00100000:2.0:1776187967.304728:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061378dda pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11404:x1862467653408448:12345-192.168.204.20@tcp:101:date.0 Request processed in 1798us (8772us total) trans 0 rc 301/301 00000100:00100000:2.0:1776187967.304738:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15352 00000100:00100000:2.0:1776187967.313503:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.313791:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408576 00000100:00100000:1.0:1776187967.313914:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15353 00000100:00100000:1.0:1776187967.313923:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000102a405b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11404:x1862467653408576:12345-192.168.204.20@tcp:101:date.0 00010000:00010000:1.0:1776187967.313954:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.313985:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439dd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab0b expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314074:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ddc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314092:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ddc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314106:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ddc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314121:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439de3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314127:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314134:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314246:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ddc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314255:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ddc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314268:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ddc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314274:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.314278:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ddc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314286:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ddc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314304:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.314307:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.314312:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ddc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314319:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ddc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314344:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439de3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314349:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439de3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314355:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314360:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.314362:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439de3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314368:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439de3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314375:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x820cea43 (00000000194664fe) 00010000:00010000:1.0:1776187967.314377:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.314380:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439de3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314385:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439de3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314427:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439dd5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab0b expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314435:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439dd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab0b expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.314445:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd5541f4, rc 0) 00000100:00100000:1.0:1776187967.314537:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000102a405b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11404:x1862467653408576:12345-192.168.204.20@tcp:101:date.0 Request processed in 613us (1042us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.314545:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15353 00010000:00010000:2.0:1776187967.336210:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187967.336728:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.337660:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408640 00000100:00100000:1.0:1776187967.337736:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15354 00000100:00100000:1.0:1776187967.337744:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008baa385e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11277:x1862467653408640:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1776187967.337767:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.337792:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439dea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab12 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.337868:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439df1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.337925:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439df1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.337936:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439df1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.337951:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439df8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x4e1a61e4 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.337956:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.337961:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338041:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439df1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338048:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439df1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338055:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439df1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338061:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.338065:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439df1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338073:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439df1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338085:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.338089:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.338092:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439df1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338098:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439df1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338110:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439df8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338116:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439df8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338122:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439df8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338128:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.338129:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439df8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338135:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439df8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338141:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x4e1a61e4 (00000000194664fe) 00010000:00010000:1.0:1776187967.338144:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.338146:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439df8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338150:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439df8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x4e1a61e4 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338181:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439dea lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab12 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338199:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439dea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab12 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.338208:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd5541f4, rc 0) 00000100:00100000:1.0:1776187967.338488:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008baa385e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11277:x1862467653408640:12345-192.168.204.20@tcp:101:bash.0 Request processed in 742us (1766us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.338496:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15354 00000100:00100000:0.0:1776187967.351102:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.351222:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408768 00000100:00100000:2.0:1776187967.351282:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15355 00000100:00100000:2.0:1776187967.351289:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7827538 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653408768:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:2.0:1776187967.351313:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.351345:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439dff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab19 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351418:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351435:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351446:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351461:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x5eacde bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351467:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351473:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351555:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351563:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351569:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351574:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000597b6781 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.351577:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351584:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351596:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187967.351598:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.351602:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351607:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351619:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351625:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351634:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351639:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.351640:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351646:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351666:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x5eacde (0000000063901265) 00010000:00010000:2.0:1776187967.351668:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.351670:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351675:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x5eacde bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351709:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439dff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab19 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351717:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439dff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab19 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.351725:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000791f3e8c, rc 0) 00000100:00100000:2.0:1776187967.351790:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7827538 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653408768:12345-192.168.204.20@tcp:101:ps.0 Request processed in 500us (696us total) trans 0 rc 301/301 00000100:00100000:2.0:1776187967.351798:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15355 00000100:00100000:3.0:1776187967.360926:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.361034:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653408896 00000100:00100000:1.0:1776187967.361098:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15356 00000100:00100000:1.0:1776187967.361105:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd15604b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653408896:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:1.0:1776187967.361125:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.361147:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab20 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361229:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361244:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361258:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361272:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x55f752d8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361278:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361284:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361364:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361372:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361378:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361384:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.361388:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361394:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361404:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.361407:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.361411:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361417:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361430:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361435:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361440:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361445:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.361447:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361453:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361459:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x55f752d8 (00000000194664fe) 00010000:00010000:1.0:1776187967.361462:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.361463:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361469:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x55f752d8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361507:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e14 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab20 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361514:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab20 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.361523:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd5541f4, rc 0) 00000100:00100000:1.0:1776187967.361571:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd15604b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653408896:12345-192.168.204.20@tcp:101:ps.0 Request processed in 466us (701us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.361579:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15356 00000100:00100000:3.0:1776187967.367438:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.367556:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653409024 00000100:00100000:2.0:1776187967.367606:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15357 00000100:00100000:2.0:1776187967.367614:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb47b901 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409024:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:2.0:1776187967.367639:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.367672:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439e29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab27 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.367756:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.367771:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.367783:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.367796:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xaf3dc4c9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.367802:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.367809:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.367923:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.367931:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368177:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368190:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.368195:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368202:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368214:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187967.368216:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.368220:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368225:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368239:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368244:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368249:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368253:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000597b6781 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.368255:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368260:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368267:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0xaf3dc4c9 (0000000063901265) 00010000:00010000:2.0:1776187967.368269:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.368270:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368275:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xaf3dc4c9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368309:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439e29 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab27 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368316:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439e29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab27 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.368323:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000791f3e8c, rc 0) 00000100:00100000:2.0:1776187967.368383:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb47b901 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409024:12345-192.168.204.20@tcp:101:ps.0 Request processed in 769us (954us total) trans 0 rc 301/301 00000100:00100000:2.0:1776187967.368390:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15357 00000100:00100000:0.0:1776187967.377063:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.377240:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653409152 00000100:00100000:1.0:1776187967.377300:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15358 00000100:00100000:1.0:1776187967.377307:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409152:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:1.0:1776187967.377339:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.377364:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab2e expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377444:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377457:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377468:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377483:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x46114526 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377491:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377496:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377569:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377577:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377584:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377590:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.377594:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377600:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377611:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.377614:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.377618:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377624:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377641:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377647:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377664:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377669:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.377671:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377677:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377684:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x46114526 (00000000194664fe) 00010000:00010000:1.0:1776187967.377693:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.377695:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377701:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x46114526 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377735:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e3e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab2e expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377742:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab2e expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.377757:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd5541f4, rc 0) 00000100:00100000:1.0:1776187967.377820:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409152:12345-192.168.204.20@tcp:101:ps.0 Request processed in 513us (766us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.377828:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15358 00000100:00100000:3.0:1776187967.384659:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.384773:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653409280 00000100:00100000:2.0:1776187967.384834:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15359 00000100:00100000:2.0:1776187967.384840:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ac78150 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409280:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:2.0:1776187967.384864:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.384925:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439e53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab35 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385011:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385026:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385037:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385050:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x907a850 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385060:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385066:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385142:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385149:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385155:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385161:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000597b6781 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.385165:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385172:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385194:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187967.385198:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.385201:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385207:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439e5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385221:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385227:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385232:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385238:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.385240:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385245:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385251:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x907a850 (0000000063901265) 00010000:00010000:2.0:1776187967.385254:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.385256:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385261:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439e61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x907a850 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385395:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439e53 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab35 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385403:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439e53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab35 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.385411:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000791f3e8c, rc 0) 00000100:00100000:2.0:1776187967.385461:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ac78150 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409280:12345-192.168.204.20@tcp:101:ps.0 Request processed in 620us (816us total) trans 0 rc 301/301 00000100:00100000:2.0:1776187967.385468:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15359 00000100:00100000:3.0:1776187967.392295:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.392461:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653409408 00000100:00100000:1.0:1776187967.392519:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15360 00000100:00100000:1.0:1776187967.392526:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9c2e81b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409408:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:1.0:1776187967.392546:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.392566:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab3c expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392653:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392668:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392679:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392691:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x85a1b653 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392698:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392703:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392775:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392782:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392788:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392793:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.392796:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392803:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392815:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.392818:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.392821:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392828:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392841:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392846:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392857:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392862:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.392864:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.392868:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.393065:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x85a1b653 (00000000194664fe) 00010000:00010000:1.0:1776187967.393067:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.393069:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.393075:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x85a1b653 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.393110:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e68 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab3c expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.393117:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab3c expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.393126:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd5541f4, rc 0) 00000100:00100000:1.0:1776187967.393196:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9c2e81b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409408:12345-192.168.204.20@tcp:101:ps.0 Request processed in 669us (910us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.393203:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15360 00000100:00100000:0.0:1776187967.406570:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.409849:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653409536 00000100:00100000:1.0:1776187967.410429:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15361 00000100:00100000:1.0:1776187967.410438:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bead27ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409536:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:1.0:1776187967.410463:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.410488:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab43 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.410570:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.410586:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.410599:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.410617:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x102009d5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.410624:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.410631:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.413909:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.413930:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.413943:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.413950:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.413955:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.413963:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.413979:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.413982:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.413986:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.413992:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439e84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.414005:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.414010:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.414015:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.414018:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.414020:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.414025:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.414031:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x102009d5 (00000000194664fe) 00010000:00010000:1.0:1776187967.414032:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.414034:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.414038:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439e8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x102009d5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.414099:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e7d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab43 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.414106:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439e7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab43 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.414118:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd5541f4, rc 0) 00000100:00100000:1.0:1776187967.414226:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bead27ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409536:12345-192.168.204.20@tcp:101:ps.0 Request processed in 3786us (7665us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.414236:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15361 00000100:00100000:3.0:1776187967.418965:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.419099:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653409664 00000100:00100000:1.0:1776187967.419310:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15362 00000100:00100000:1.0:1776187967.419317:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016d03f4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409664:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:1.0:1776187967.419349:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.419371:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439e92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab4a expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419452:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439e99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419467:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439e99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419478:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439e99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419492:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x42ab077a bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419499:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419505:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419581:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439e99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419588:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439e99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419594:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419599:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d719b35a already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.419602:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419609:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439e99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419620:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.419622:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.419626:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439e99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419630:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee439e99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419642:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419646:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419667:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419672:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cea3a6c8 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.419674:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419680:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419687:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x42ab077a (000000003d48dd25) 00010000:00010000:1.0:1776187967.419689:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.419691:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439ea0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419696:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee439ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x42ab077a bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419735:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439e92 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab4a expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419742:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439e92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab4a expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.419751:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d26d87db, rc 0) 00000100:00100000:1.0:1776187967.419822:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016d03f4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409664:12345-192.168.204.20@tcp:101:ps.0 Request processed in 504us (863us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.419830:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15362 00000100:00100000:3.0:1776187967.427375:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.428049:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653409792 00000100:00100000:1.0:1776187967.428097:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15363 00000100:00100000:1.0:1776187967.428103:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d211c1ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409792:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:1.0:1776187967.428123:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.428143:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439ea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab51 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428232:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439eae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428248:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439eae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428262:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439eae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428275:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439eb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x28a377f8 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428281:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428286:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428375:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439eae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428383:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439eae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428390:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439eae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428395:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.428398:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439eae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428403:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439eae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428414:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.428417:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.428420:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439eae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428425:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439eae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428437:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428441:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428445:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428450:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.428451:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428455:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428460:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x28a377f8 (00000000194664fe) 00010000:00010000:1.0:1776187967.428461:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.428462:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439eb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428466:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439eb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x28a377f8 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428506:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439ea7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab51 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428514:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439ea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab51 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.428522:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd5541f4, rc 0) 00000100:00100000:1.0:1776187967.428587:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d211c1ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409792:12345-192.168.204.20@tcp:101:ps.0 Request processed in 483us (1221us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.428594:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15363 00000100:00100000:0.0:1776187967.435617:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.435784:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653409920 00000100:00100000:2.0:1776187967.435854:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15364 00000100:00100000:2.0:1776187967.435862:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d3cb9e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409920:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:2.0:1776187967.435915:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.435941:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439ebc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab58 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436011:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ec3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436025:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436044:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436061:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x90ba0166 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436068:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436075:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436156:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ec3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436166:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ec3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436174:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436180:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.436194:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ec3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436201:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ec3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436211:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187967.436214:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.436217:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ec3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436223:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ec3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436234:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436239:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436244:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436248:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000597b6781 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.436250:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436255:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436260:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x90ba0166 (0000000063901265) 00010000:00010000:2.0:1776187967.436263:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.436265:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436270:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x90ba0166 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436306:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439ebc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab58 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436314:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439ebc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab58 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.436322:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000791f3e8c, rc 0) 00000100:00100000:2.0:1776187967.436382:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d3cb9e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653409920:12345-192.168.204.20@tcp:101:ps.0 Request processed in 519us (775us total) trans 0 rc 301/301 00000100:00100000:2.0:1776187967.436390:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15364 00000100:00100000:3.0:1776187967.441202:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.441554:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653410048 00000100:00100000:1.0:1776187967.441644:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15365 00000100:00100000:1.0:1776187967.441652:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005a2f2ffd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410048:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:1.0:1776187967.441679:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.441704:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439ed1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab5f expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.441793:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ed8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.441809:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.441822:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.441838:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439edf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xce5b6a33 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.441845:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.441852:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.441964:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ed8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.441982:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ed8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.441988:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.441994:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.441997:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442003:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ed8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442013:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.442016:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.442019:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ed8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442025:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ed8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442041:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439edf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442047:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439edf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442053:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439edf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442058:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.442060:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439edf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442066:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439edf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442073:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0xce5b6a33 (00000000194664fe) 00010000:00010000:1.0:1776187967.442076:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.442077:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439edf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442082:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439edf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xce5b6a33 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442117:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439ed1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab5f expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442124:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439ed1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab5f expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.442138:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd5541f4, rc 0) 00000100:00100000:1.0:1776187967.442263:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005a2f2ffd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410048:12345-192.168.204.20@tcp:101:ps.0 Request processed in 611us (1082us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.442271:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15365 00000100:00100000:3.0:1776187967.446602:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.446784:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653410176 00000100:00100000:2.0:1776187967.446849:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15366 00000100:00100000:2.0:1776187967.446857:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b916d83 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410176:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:2.0:1776187967.446922:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.446947:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439ee6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab66 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447067:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447084:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447096:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447112:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ef4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xe87eaafc bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447119:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447125:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447208:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447216:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447224:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447230:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000597b6781 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.447233:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447241:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447254:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187967.447257:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.447261:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447267:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447286:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447292:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ef4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447298:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447303:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.447305:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447311:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ef4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447317:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0xe87eaafc (0000000063901265) 00010000:00010000:2.0:1776187967.447319:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.447320:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ef4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447325:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439ef4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xe87eaafc bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447359:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439ee6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab66 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447367:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439ee6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab66 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.447376:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000791f3e8c, rc 0) 00000100:00100000:2.0:1776187967.447448:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b916d83 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410176:12345-192.168.204.20@tcp:101:ps.0 Request processed in 590us (858us total) trans 0 rc 301/301 00000100:00100000:2.0:1776187967.447457:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15366 00000100:00100000:0.0:1776187967.453090:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.453203:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653410304 00000100:00100000:2.0:1776187967.453259:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15367 00000100:00100000:2.0:1776187967.453265:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037547e6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410304:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:2.0:1776187967.453289:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.453313:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab6d expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453401:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453418:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453429:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453445:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xc9c87587 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453452:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453458:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453541:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453548:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453554:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453559:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006b72ffb6 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.453563:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453570:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453581:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187967.453584:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.453588:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453594:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453606:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453611:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453620:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453625:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000006942ede already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.453626:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453631:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453638:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0xc9c87587 (0000000079764c80) 00010000:00010000:2.0:1776187967.453640:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.453642:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453647:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xc9c87587 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453697:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439efb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab6d expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453704:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab6d expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.453713:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d81ab485, rc 0) 00000100:00100000:2.0:1776187967.453782:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037547e6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410304:12345-192.168.204.20@tcp:101:ps.0 Request processed in 516us (704us total) trans 0 rc 301/301 00000100:00100000:2.0:1776187967.453790:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15367 00000100:00100000:3.0:1776187967.458043:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.458217:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653410432 00000100:00100000:0.0:1776187967.458283:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15368 00000100:00100000:0.0:1776187967.458289:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ad97c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410432:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:0.0:1776187967.458316:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187967.458349:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439f10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab74 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458426:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439f17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458443:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439f17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458454:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439f17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458470:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xfb43d54d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458476:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458482:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458572:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439f17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458579:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439f17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458585:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439f17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458595:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d612a45d already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187967.458600:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439f17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458607:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439f17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458618:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:0.0:1776187967.458621:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187967.458625:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439f17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458630:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439f17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458643:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458939:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458947:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458952:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a9283777 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187967.458955:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458962:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458972:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0xfb43d54d (00000000219adb48) 00010000:00010000:0.0:1776187967.458975:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187967.458977:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439f1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.458983:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xfb43d54d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.459026:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439f10 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab74 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.459034:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439f10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab74 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.459042:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092f8fdca, rc 0) 00000100:00100000:0.0:1776187967.459129:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ad97c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410432:12345-192.168.204.20@tcp:101:ps.0 Request processed in 838us (1094us total) trans 0 rc 301/301 00000100:00100000:0.0:1776187967.459137:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15368 00000100:00100000:3.0:1776187967.476761:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.477712:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653410560 00000100:00100000:0.0:1776187967.477786:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15369 00000100:00100000:0.0:1776187967.477793:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b4f1da6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410560:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:0.0:1776187967.477817:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187967.477840:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439f25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab7b expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478138:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478156:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478167:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478179:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x2ca39d83 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478197:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478203:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478269:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478275:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478281:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478288:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.478292:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478298:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478308:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.478310:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.478313:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478318:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478330:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478335:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478340:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478345:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.478346:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478351:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478366:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x2ca39d83 (00000000194664fe) 00010000:00010000:1.0:1776187967.478369:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.478371:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478377:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x2ca39d83 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478411:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439f25 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab7b expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478418:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee439f25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab7b expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.478428:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092f8fdca, rc 0) 00000100:00100000:1.0:1776187967.478656:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b4f1da6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410560:12345-192.168.204.20@tcp:101:ps.0 Request processed in 861us (1909us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.478665:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15369 00000100:00100000:3.0:1776187967.484140:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.484207:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653410688 00000100:00100000:1.0:1776187967.484277:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15370 00000100:00100000:1.0:1776187967.484283:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d402306 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410688:12345-192.168.204.20@tcp:101:ps.0 00010000:00010000:1.0:1776187967.484305:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.484326:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab82 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.484847:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.484867:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.484913:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.484928:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xb8395982 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.484935:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.484941:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485035:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485043:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485050:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485056:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.485060:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485067:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485079:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.485083:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.485086:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485092:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485107:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485112:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485117:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485122:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.485124:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485130:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485137:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0xb8395982 (00000000194664fe) 00010000:00010000:1.0:1776187967.485139:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.485141:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485151:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0xb8395982 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485197:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f3a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab82 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485205:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab82 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.485214:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e5979b39, rc 0) 00000100:00100000:1.0:1776187967.485300:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d402306 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11405:x1862467653410688:12345-192.168.204.20@tcp:101:ps.0 Request processed in 1016us (1167us total) trans 0 rc 301/301 00000100:00100000:1.0:1776187967.485310:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15370 00000100:00100000:3.0:1776187967.575484:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.575618:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653410752 00000100:00100000:2.0:1776187967.575680:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15371 00000100:00100000:2.0:1776187967.575688:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0b0b298 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11277:x1862467653410752:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:2.0:1776187967.575711:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.575737:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439f4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab89 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.575821:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.575838:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.575851:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.575867:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x7393eb54 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.575913:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.575920:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.575997:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576004:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576016:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576022:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000006942ede already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.576026:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576033:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576044:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:2.0:1776187967.576046:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.576050:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576056:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439f56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576067:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576073:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576079:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576083:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006b72ffb6 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.576085:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576091:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576097:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x7393eb54 (0000000079764c80) 00010000:00010000:2.0:1776187967.576100:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.576101:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576106:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439f5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x7393eb54 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576135:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439f4f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab89 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576143:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439f4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab89 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.576152:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d81ab485, rc 0) 00000100:00100000:2.0:1776187967.576221:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0b0b298 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11277:x1862467653410752:12345-192.168.204.20@tcp:101:bash.0 Request processed in 532us (751us total) trans 0 rc 301/301 00000100:00100000:2.0:1776187967.576228:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15371 00000100:00100000:3.0:1776187967.592045:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.592243:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653410816 00000100:00100000:1.0:1776187967.592308:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15372 00000100:00100000:1.0:1776187967.592315:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000671fe4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11406:x1862467653410816:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1776187967.592338:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.592364:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab90 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592425:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592441:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592454:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592471:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592478:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592483:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592600:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592608:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592615:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1776187967.592667:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f1:0x0]: returning size 11776 00000004:00200000:1.0:1776187967.592671:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1776187967.592695:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592707:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592714:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592721:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592728:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.592731:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592737:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592748:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:1.0:1776187967.592750:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.592754:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592759:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439f6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592770:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592776:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592782:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592787:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.592789:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592794:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592801:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x12eaac0d (00000000194664fe) 00010000:00010000:1.0:1776187967.592803:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.592805:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592810:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592840:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab90 expref: 434 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592854:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab90 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.592860:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (000000003d48dd25) 00010000:00010000:1.0:1776187967.592862:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1776187967.592863:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d26d87db, rc 0) 00000100:00100000:1.0:1776187967.592972:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000671fe4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11406:x1862467653410816:12345-192.168.204.20@tcp:101:rm.0 Request processed in 656us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187967.592980:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15372 00000100:00100000:3.0:1776187967.597620:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.597745:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653410944 00000100:00100000:2.0:1776187967.597817:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15373 00000100:00100000:2.0:1776187967.597826:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e45ad3e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11406:x1862467653410944:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187967.597852:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.597898:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439f80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab97 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187967.598022:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f1:0x0]: returning size 11776 00010000:00010000:2.0:1776187967.598147:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439f80 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab97 expref: 435 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.598156:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439f80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab97 expref: 435 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.598169:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d81ab485, rc 0) 00000100:00100000:2.0:1776187967.598236:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e45ad3e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653410944:12345-192.168.204.20@tcp:101:rm.0 Request processed in 410us (624us total) trans 4294975092 rc 301/301 00000100:00100000:2.0:1776187967.598244:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15373 00000100:00100000:3.0:1776187967.603449:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.603557:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411008 00000100:00100000:2.0:1776187967.603617:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4474 00000100:00100000:2.0:1776187967.603623:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e0f0926 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653411008:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187967.611721:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e0f0926 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653411008:12345-192.168.204.20@tcp:37:rm.0 Request processed in 8086us (8269us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.611739:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4474 00000100:00100000:3.0:1776187967.615847:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.616174:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411136 00000100:00100000:2.0:1776187967.617176:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4475 00000100:00100000:2.0:1776187967.617197:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e06687 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653411136:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187967.617682:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e06687 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11406:x1862467653411136:12345-192.168.204.20@tcp:35:rm.0 Request processed in 486us (1846us total) trans 4294975093 rc 0/0 00000100:00100000:2.0:1776187967.617691:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4475 00000100:00100000:3.0:1776187967.625684:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.626027:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411264 00000100:00100000:1.0:1776187967.626089:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15374 00000100:00100000:1.0:1776187967.626096:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f36a4a62 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11406:x1862467653411264:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1776187967.626121:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.626145:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cab9e expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.626832:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.626849:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.626859:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1776187967.626870:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f1:0x0]: returning size 11776 00010000:00010000:1.0:1776187967.627091:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439f8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab9e expref: 438 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.627109:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab9e expref: 437 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.627117:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (000000003d48dd25) 00010000:00010000:1.0:1776187967.627119:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1776187967.627122:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000dd5541f4, rc 0) 00000100:00100000:1.0:1776187967.627199:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f36a4a62 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11406:x1862467653411264:12345-192.168.204.20@tcp:101:rm.0 Request processed in 1101us (1522us total) trans 4294975094 rc 0/0 00000100:00100000:1.0:1776187967.627207:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15374 00000100:00100000:3.0:1776187967.641141:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.641474:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411328 00000100:00100000:2.0:1776187967.641548:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15375 00000100:00100000:2.0:1776187967.641555:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016e072e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11406:x1862467653411328:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187967.641583:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.641607:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439fa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24caba5 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.641691:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439faa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.641707:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.641720:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187967.641796:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f3:0x0]: returning size 11776 00000004:00200000:2.0:1776187967.641801:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187967.641830:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.641861:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee439fa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caba5 expref: 439 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.646438:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caba5 expref: 438 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.646456:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (00000000cf81227d) 00010000:00010000:2.0:1776187967.646459:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187967.646464:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006b72ffb6, rc 0) 00000100:00100000:2.0:1776187967.646568:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016e072e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11406:x1862467653411328:12345-192.168.204.20@tcp:101:rm.0 Request processed in 5010us (5433us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.646579:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15375 00000100:00100000:3.0:1776187967.647718:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.648108:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411392 00000100:00100000:2.0:1776187967.648337:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15376 00000100:00100000:2.0:1776187967.648346:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045040602 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:2223:x1862467653411392:12345-192.168.204.20@tcp:101:ll_sa_11406.0 00010000:00010000:2.0:1776187967.648373:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.648395:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439fb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabac expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648464:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439fb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648479:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648491:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648505:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648512:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648518:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648627:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439fc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648641:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648647:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187967.648683:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f4:0x0]: returning size 11776 00000004:00200000:2.0:1776187967.648686:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187967.648718:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648729:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439fb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648734:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439fb8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648740:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648745:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000791f3e8c already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.648748:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439fb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648754:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439fb8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648765:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (000000003d48dd25) 00010000:00010000:2.0:1776187967.648767:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.648771:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439fb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648776:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee439fb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648788:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648793:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648798:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648816:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.648818:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648823:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648829:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x977fac0d (0000000079764c80) 00010000:00010000:2.0:1776187967.648831:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.648832:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648837:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648863:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439fb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabac expref: 440 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648916:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabac expref: 439 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.648923:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (00000000b347ce5e) 00010000:00010000:2.0:1776187967.648924:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187967.648926:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000597b6781, rc 0) 00000100:00100000:2.0:1776187967.649001:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045040602 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+439:2223:x1862467653411392:12345-192.168.204.20@tcp:101:ll_sa_11406.0 Request processed in 655us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.649008:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15376 00000100:00100000:3.0:1776187967.656122:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.656528:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411456 00000100:00100000:0.0:1776187967.656595:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4476 00000100:00100000:0.0:1776187967.656603:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f05231aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+439:11406:x1862467653411456:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:0.0:1776187967.660572:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f05231aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+439:11406:x1862467653411456:12345-192.168.204.20@tcp:37:rm.0 Request processed in 3959us (4452us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187967.660589:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4476 00000100:00100000:3.0:1776187967.669017:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.669452:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411520 00000100:00100000:0.0:1776187967.669512:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4477 00000100:00100000:0.0:1776187967.669519:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d28f60a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+439:11406:x1862467653411520:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:0.0:1776187967.675871:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d28f60a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+439:11406:x1862467653411520:12345-192.168.204.20@tcp:37:rm.0 Request processed in 6345us (6853us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187967.675912:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4477 00000100:00100000:3.0:1776187967.680145:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.680338:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411584 00000100:00100000:2.0:1776187967.680450:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15377 00000100:00100000:2.0:1776187967.680457:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006072665c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+439:11406:x1862467653411584:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187967.680480:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.680502:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439fcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabb3 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.680568:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x210:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.680583:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.680595:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187967.680669:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x210:0x0]: returning size 11776 00000004:00200000:2.0:1776187967.680673:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187967.680699:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.680724:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439fcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabb3 expref: 441 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.680740:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x210:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabb3 expref: 440 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.680748:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x0 (00000000eec748e5) 00010000:00010000:2.0:1776187967.680751:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187967.680754:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000088423517, rc 0) 00000100:00100000:2.0:1776187967.680818:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006072665c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+440:11406:x1862467653411584:12345-192.168.204.20@tcp:101:rm.0 Request processed in 360us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.680825:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15377 00000100:00100000:3.0:1776187967.685358:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.685854:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411648 00000100:00100000:2.0:1776187967.685918:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4478 00000100:00100000:2.0:1776187967.685925:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e9f160d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+440:11406:x1862467653411648:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187967.693086:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e9f160d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+440:11406:x1862467653411648:12345-192.168.204.20@tcp:37:rm.0 Request processed in 7153us (7727us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.693104:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4478 00000100:00100000:1.0:1776187967.698157:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.698276:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411776 00000100:00100000:2.0:1776187967.698344:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4479 00000100:00100000:2.0:1776187967.698352:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fffd3274 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+440:11406:x1862467653411776:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187967.698785:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fffd3274 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+441:11406:x1862467653411776:12345-192.168.204.20@tcp:35:rm.0 Request processed in 433us (635us total) trans 4294975095 rc 0/0 00000100:00100000:2.0:1776187967.698794:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4479 00000100:00100000:0.0:1776187967.705583:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.705840:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411904 00000100:00100000:0.0:1776187967.706160:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15378 00000100:00100000:0.0:1776187967.706168:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d9b6c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+441:11406:x1862467653411904:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:0.0:1776187967.706238:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1776187967.706263:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee439fd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x210:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabb3 expref: 441 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706286:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004d9f7000/0x92b1eb87ee42230a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x210:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c347b expref: 440 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706298:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ea87f3a7/0x92b1eb87ee41e1a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x210:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bdf expref: 439 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706308:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000078914b18/0x92b1eb87ee41e0c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x210:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b8b expref: 438 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706335:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x0 (00000000eec748e5) 00010000:00010000:0.0:1776187967.706348:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cce6495a/0x92b1eb87ee420a44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c63 expref: 437 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706356:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:0.0:1776187967.706359:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187967.706390:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439fdb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706404:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439fdb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706414:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439fdb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706428:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706434:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706440:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706549:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x210:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706556:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.706567:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187967.707958:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4740, 176 off833944 00000004:00200000:0.0:1776187967.708083:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x210:0x0]: returning size 11776 00000004:00010000:0.0:1776187967.708101:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009d9b6c26 reply state 00000000fe8f65e1 transno 4294975096 ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.708144:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439fdb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.708150:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439fdb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.708156:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439fdb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.708162:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a9283777 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187967.708165:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439fdb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.708172:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439fdb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.708195:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:0.0:1776187967.708198:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187967.708203:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439fdb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.708213:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee439fdb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187967.708223:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009d9b6c26 reply state 00000000fe8f65e1 transno 4294975096 ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187967.708370:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d9b6c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11406:x1862467653411904:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2199us (2794us total) trans 4294975096 rc 0/0 00000100:00100000:0.0:1776187967.708379:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15378 00000100:00100000:2.0:1776187967.713157:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187967.713266:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713281:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713288:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713295:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d612a45d already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187967.713300:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713307:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713330:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0xddbda88f (00000000219adb48) 00010000:00010000:0.0:1776187967.713332:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187967.713336:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713343:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee439fe2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713362:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713367:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713372:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713376:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b23405f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187967.713378:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713382:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713389:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x210:0x0].0x0 (00000000693f1349) 00010000:00010000:0.0:1776187967.713390:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187967.713392:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.713397:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee439fe9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x210:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.713525:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653411968 00000100:00100000:1.0:1776187967.713626:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15379 00000100:00100000:1.0:1776187967.713634:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000140b6540 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11406:x1862467653411968:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1776187967.713765:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187967.713786:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ff0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabba expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.713852:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ff7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.713868:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x244:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.713908:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x244:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1776187967.713984:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x244:0x0]: returning size 12800 00000004:00200000:1.0:1776187967.713988:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1776187967.714011:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x244:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.714037:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee439ff0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabba expref: 439 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.714051:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x244:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabba expref: 438 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.714058:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:1.0:1776187967.714060:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1776187967.714062:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000ea47fb5, rc 0) 00000100:00100000:1.0:1776187967.714121:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000140b6540 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11406:x1862467653411968:12345-192.168.204.20@tcp:101:rm.0 Request processed in 487us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187967.714129:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15379 00000100:00100000:0.0:1776187967.718505:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187967.718587:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653412032 00000100:00100000:3.0:1776187967.718640:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4480 00000100:00100000:3.0:1776187967.718654:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060f785d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11406:x1862467653412032:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:1.0:1776187967.726860:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060f785d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11406:x1862467653412032:12345-192.168.204.20@tcp:37:rm.0 Request processed in 8197us (8354us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187967.727052:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4480 00000100:00100000:0.0:1776187967.733055:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.733157:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653412160 00000100:00100000:1.0:1776187967.733249:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4481 00000100:00100000:1.0:1776187967.733256:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003982ab95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11406:x1862467653412160:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:1.0:1776187967.733682:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003982ab95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+439:11406:x1862467653412160:12345-192.168.204.20@tcp:35:rm.0 Request processed in 424us (633us total) trans 4294975097 rc 0/0 00000100:00100000:1.0:1776187967.733692:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4481 00000100:00100000:0.0:1776187967.736616:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.736821:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653412288 00000100:00100000:2.0:1776187967.736913:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15380 00000100:00100000:2.0:1776187967.736920:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e9d400a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+439:11406:x1862467653412288:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187967.736975:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187967.737002:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee439ff7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x244:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabba expref: 439 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737027:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006370b91/0x92b1eb87ee424c62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x244:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c41f6 expref: 438 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737040:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000072b79122/0x92b1eb87ee41f65c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x244:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2428 expref: 437 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737049:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001251a504/0x92b1eb87ee41f5bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x244:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c23e9 expref: 436 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737060:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (00000000bacc4eb7) 00010000:00010000:2.0:1776187967.737069:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187967.737107:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439ffe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737122:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439ffe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737131:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439ffe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737147:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737153:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737158:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737285:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x244:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737293:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.737299:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187967.738779:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4741, 176 off834120 00000004:00200000:2.0:1776187967.738852:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x244:0x0]: returning size 12800 00000004:00010000:2.0:1776187967.738869:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002e9d400a reply state 0000000002b445d5 transno 4294975098 ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.739115:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439ffe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.739124:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439ffe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.739135:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439ffe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.739140:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000006942ede already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.739143:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439ffe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.739150:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439ffe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.739163:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:2.0:1776187967.739166:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.739170:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439ffe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.739185:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee439ffe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187967.739196:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002e9d400a reply state 0000000002b445d5 transno 4294975098 ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187967.739292:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e9d400a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11406:x1862467653412288:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2370us (2681us total) trans 4294975098 rc 0/0 00000100:00100000:2.0:1776187967.739301:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15380 00000100:00100000:0.0:1776187967.743134:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1776187967.743223:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743239:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743245:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743251:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000791f3e8c already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.743255:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743262:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743279:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x56ca4f59 (0000000079764c80) 00010000:00010000:1.0:1776187967.743282:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.743286:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743298:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a005 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743315:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743332:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743338:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743342:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d81ab485 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.743344:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743349:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743356:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x244:0x0].0x0 (0000000063901265) 00010000:00010000:1.0:1776187967.743358:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187967.743361:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.743365:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a00c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x244:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187967.743595:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653412352 00000100:00100000:2.0:1776187967.743656:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15381 00000100:00100000:2.0:1776187967.743663:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f18ed5c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11406:x1862467653412352:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187967.743691:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.743708:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a013 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabc1 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.743789:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a01a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.743804:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a01a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.743815:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a01a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187967.743910:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x21c:0x0]: returning size 12800 00000004:00200000:2.0:1776187967.743913:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187967.743939:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a01a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.743964:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a013 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabc1 expref: 438 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.743989:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a01a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabc1 expref: 437 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.743996:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:2.0:1776187967.743998:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187967.744000:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000009d004fc, rc 0) 00000100:00100000:2.0:1776187967.744054:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f18ed5c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11406:x1862467653412352:12345-192.168.204.20@tcp:101:rm.0 Request processed in 391us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.744066:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15381 00000100:00100000:1.0:1776187967.749496:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.749625:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653412416 00000100:00100000:2.0:1776187967.749690:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4482 00000100:00100000:2.0:1776187967.749696:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fffd3274 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11406:x1862467653412416:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187967.756298:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fffd3274 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11406:x1862467653412416:12345-192.168.204.20@tcp:37:rm.0 Request processed in 6590us (6799us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.756326:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4482 00000100:00100000:0.0:1776187967.762129:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.762228:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653412544 00000100:00100000:2.0:1776187967.762283:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4483 00000100:00100000:2.0:1776187967.762290:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000346ea37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11406:x1862467653412544:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187967.762706:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000346ea37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11406:x1862467653412544:12345-192.168.204.20@tcp:35:rm.0 Request processed in 414us (585us total) trans 4294975099 rc 0/0 00000100:00100000:2.0:1776187967.762714:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4483 00000100:00100000:2.0:1776187967.767316:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187967.767484:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653412672 00000100:00100000:3.0:1776187967.767545:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15382 00000100:00100000:3.0:1776187967.767552:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+438:11406:x1862467653412672:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1776187967.767605:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187967.767630:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a01a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabc1 expref: 438 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767658:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082df7ac1/0x92b1eb87ee422c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c378b expref: 437 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767670:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000df719b61/0x92b1eb87ee41e6a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1dd7 expref: 436 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767686:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000071924960/0x92b1eb87ee41e5c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d83 expref: 435 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767694:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (00000000e28cbcfe) 00010000:00010000:3.0:1776187967.767704:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187967.767735:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767749:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767758:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767769:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767775:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767781:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767918:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767926:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.767936:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187967.768598:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4742, 176 off834296 00000004:00200000:3.0:1776187967.768657:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x21c:0x0]: returning size 12800 00000004:00010000:3.0:1776187967.768671:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002ccf39a0 reply state 00000000d531cd5f transno 4294975100 ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.768704:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.768710:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a021 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.768717:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.768722:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000503e410b already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.768726:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.768732:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a021 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.768741:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:3.0:1776187967.768744:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.768746:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a021 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.768757:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a021 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187967.768764:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002ccf39a0 reply state 00000000d531cd5f transno 4294975100 ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187967.768835:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11406:x1862467653412672:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1280us (1523us total) trans 4294975100 rc 0/0 00000100:00100000:3.0:1776187967.768843:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15382 00000100:00100000:1.0:1776187967.772153:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187967.772277:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772292:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772300:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772306:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030f1f9ad already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187967.772310:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772324:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772342:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x8cffc40b (00000000866a3643) 00010000:00010000:0.0:1776187967.772345:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187967.772348:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772354:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030f1f9ad/0x92b1eb87ee43a028 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772372:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772377:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772383:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772388:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000900c220d already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187967.772389:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772394:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772400:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21c:0x0].0x0 (0000000004f0a071) 00010000:00010000:0.0:1776187967.772402:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1776187967.772403:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.772408:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000900c220d/0x92b1eb87ee43a02f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187967.772626:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653412736 00000100:00100000:3.0:1776187967.772737:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15383 00000100:00100000:3.0:1776187967.772743:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000320f707c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11406:x1862467653412736:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1776187967.772767:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187967.772785:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a036 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabc8 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.772850:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee43a03d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.772866:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee43a03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.772917:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee43a03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187967.772989:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23c:0x0]: returning size 11776 00000004:00200000:3.0:1776187967.772993:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187967.773015:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee43a03d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.773039:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a036 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabc8 expref: 437 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.773051:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee43a03d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabc8 expref: 436 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.773057:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0x0 (00000000e23ff234) 00010000:00010000:3.0:1776187967.773060:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1776187967.773062:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b9973b27, rc 0) 00000100:00100000:3.0:1776187967.773122:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000320f707c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11406:x1862467653412736:12345-192.168.204.20@tcp:101:rm.0 Request processed in 378us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187967.773129:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15383 00000100:00100000:0.0:1776187967.779118:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.779236:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653412800 00000100:00100000:2.0:1776187967.779285:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4484 00000100:00100000:2.0:1776187967.779293:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000330d0ea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11406:x1862467653412800:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187967.784712:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000330d0ea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11406:x1862467653412800:12345-192.168.204.20@tcp:37:rm.0 Request processed in 5408us (5592us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.784729:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4484 00000100:00100000:0.0:1776187967.792583:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.792697:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653412928 00000100:00100000:2.0:1776187967.792795:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4485 00000100:00100000:2.0:1776187967.792803:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e04bcb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11406:x1862467653412928:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187967.793335:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e04bcb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11406:x1862467653412928:12345-192.168.204.20@tcp:35:rm.0 Request processed in 531us (760us total) trans 4294975101 rc 0/0 00000100:00100000:2.0:1776187967.793343:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4485 00000100:00100000:0.0:1776187967.796866:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187967.796999:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413056 00000100:00100000:2.0:1776187967.797149:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15384 00000100:00100000:2.0:1776187967.797157:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c0cad1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+437:11406:x1862467653413056:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187967.797226:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187967.797254:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b9973b27/0x92b1eb87ee43a03d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabc8 expref: 437 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797289:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002d001075/0x92b1eb87ee424570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3f9c expref: 436 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797302:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ef8ac6dc/0x92b1eb87ee41f314 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23c:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22e6 expref: 435 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797313:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000035ee04b7/0x92b1eb87ee41f273 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23c:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22a7 expref: 434 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797321:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0x0 (00000000e23ff234) 00010000:00010000:2.0:1776187967.797333:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187967.797365:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a044 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797396:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797405:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797421:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797428:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797434:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797535:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797543:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.797548:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187967.798165:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4743, 176 off834472 00000004:00200000:2.0:1776187967.798233:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23c:0x0]: returning size 11776 00000004:00010000:2.0:1776187967.798251:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c7c0cad1 reply state 00000000b97e789e transno 4294975102 ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.798301:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a044 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.798309:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a044 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.798319:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a044 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.798325:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d47697e3 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.798328:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a044 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.798336:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a044 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.798345:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:2.0:1776187967.798348:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.798350:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a044 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.798355:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a044 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187967.798364:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000c7c0cad1 reply state 00000000b97e789e transno 4294975102 ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187967.798520:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c0cad1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11406:x1862467653413056:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1359us (1660us total) trans 4294975102 rc 0/0 00000100:00100000:2.0:1776187967.798531:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15384 00010000:00010000:3.0:1776187967.803421:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803451:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803459:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803466:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000006942ede already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.803470:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803477:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803494:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x46e192ec (00000000780f5f5c) 00010000:00010000:3.0:1776187967.803498:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.803502:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803507:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a04b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803525:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803531:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803537:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803541:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aea18492 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.803542:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803548:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803554:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23c:0x0].0x0 (000000001efc7c4f) 00010000:00010000:3.0:1776187967.803556:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187967.803558:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.803568:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a052 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x23c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187967.807707:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.807787:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413120 00000100:00100000:2.0:1776187967.807855:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15385 00000100:00100000:2.0:1776187967.807863:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b38f14a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653413120:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187967.807946:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.807968:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a059 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabcf expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.808032:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x209:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.808051:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.808063:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187967.808122:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x209:0x0]: returning size 11776 00000004:00200000:2.0:1776187967.808126:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187967.808149:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.808183:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a059 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabcf expref: 436 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.808199:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x209:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabcf expref: 435 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.808206:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x0 (00000000be4d8ce3) 00010000:00010000:2.0:1776187967.808209:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187967.808212:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092776876, rc 0) 00000100:00100000:2.0:1776187967.808266:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b38f14a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11406:x1862467653413120:12345-192.168.204.20@tcp:101:rm.0 Request processed in 403us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.808275:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15385 00000100:00100000:1.0:1776187967.813144:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.813495:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413184 00000100:00100000:2.0:1776187967.813549:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4486 00000100:00100000:2.0:1776187967.813556:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006959f5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11406:x1862467653413184:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187967.818395:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006959f5c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11406:x1862467653413184:12345-192.168.204.20@tcp:37:rm.0 Request processed in 4829us (5251us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.818411:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4486 00000100:00100000:3.0:1776187967.827531:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.827692:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413312 00000100:00100000:2.0:1776187967.827797:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4487 00000100:00100000:2.0:1776187967.827805:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009726b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11406:x1862467653413312:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187967.828248:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009726b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11406:x1862467653413312:12345-192.168.204.20@tcp:35:rm.0 Request processed in 443us (728us total) trans 4294975103 rc 0/0 00000100:00100000:2.0:1776187967.828258:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4487 00000100:00100000:1.0:1776187967.830518:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.830723:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413440 00000100:00100000:2.0:1776187967.830792:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15386 00000100:00100000:2.0:1776187967.830798:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026ee736a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+436:11406:x1862467653413440:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187967.830857:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187967.831013:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x209:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabcf expref: 436 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831038:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004d577789/0x92b1eb87ee422120 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x209:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c33e1 expref: 435 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831051:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001fb3ac64/0x92b1eb87ee41df09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x209:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1adc expref: 434 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831068:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c4e9c391/0x92b1eb87ee41de14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x209:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a88 expref: 433 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831075:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x0 (00000000be4d8ce3) 00010000:00010000:2.0:1776187967.831083:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187967.831113:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a067 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831124:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a067 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831131:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a067 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831140:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831144:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831148:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831258:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x209:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831266:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.831275:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187967.831927:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4744, 176 off834648 00000004:00200000:2.0:1776187967.832016:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x209:0x0]: returning size 11776 00000004:00010000:2.0:1776187967.832030:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000026ee736a reply state 00000000a26441f6 transno 4294975104 ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.832067:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a067 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.832074:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a067 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.832080:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a067 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.832086:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8111509 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.832089:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a067 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.832095:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a067 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.832106:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:2.0:1776187967.832109:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.832112:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a067 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.832120:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a067 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187967.832128:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000026ee736a reply state 00000000a26441f6 transno 4294975104 ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187967.832232:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026ee736a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653413440:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1431us (1719us total) trans 4294975104 rc 0/0 00000100:00100000:2.0:1776187967.832241:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15386 00010000:00010000:3.0:1776187967.837252:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837274:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837282:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837290:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.837295:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837303:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837558:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0xc144154 (0000000021698773) 00010000:00010000:3.0:1776187967.837562:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.837567:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837581:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a06e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837600:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837607:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837611:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837615:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a27740b3 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.837617:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837622:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837628:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x209:0x0].0x0 (0000000090869b29) 00010000:00010000:3.0:1776187967.837630:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187967.837632:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.837637:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a075 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x209:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.838406:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.839210:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413504 00000100:00100000:2.0:1776187967.839260:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15387 00000100:00100000:2.0:1776187967.839266:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2de1de4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11406:x1862467653413504:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187967.839289:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.839322:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a07c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabd6 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.839380:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a083 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x233:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.839395:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x233:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.839404:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x233:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187967.839460:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x233:0x0]: returning size 11776 00000004:00200000:2.0:1776187967.839465:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187967.839486:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a083 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x233:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.839509:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a07c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabd6 expref: 435 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.839524:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a083 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x233:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabd6 expref: 434 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.839532:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x233:0x0].0x0 (00000000d2b686e5) 00010000:00010000:2.0:1776187967.839534:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187967.839537:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d47697e3, rc 0) 00000100:00100000:2.0:1776187967.839915:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2de1de4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653413504:12345-192.168.204.20@tcp:101:rm.0 Request processed in 647us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.839924:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15387 00000100:00100000:0.0:1776187967.854325:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.854565:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413568 00000100:00100000:2.0:1776187967.854636:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4488 00000100:00100000:2.0:1776187967.854652:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d71b17f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653413568:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187967.863933:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d71b17f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653413568:12345-192.168.204.20@tcp:37:rm.0 Request processed in 9272us (9607us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.863950:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4488 00000100:00100000:0.0:1776187967.869365:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.869527:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413696 00000100:00100000:2.0:1776187967.869635:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4489 00000100:00100000:2.0:1776187967.869643:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b2b6ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653413696:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187967.870105:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b2b6ef pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11406:x1862467653413696:12345-192.168.204.20@tcp:35:rm.0 Request processed in 457us (744us total) trans 4294975105 rc 0/0 00000100:00100000:2.0:1776187967.870114:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4489 00000100:00100000:0.0:1776187967.874190:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.874302:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413824 00000100:00100000:2.0:1776187967.874355:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15388 00000100:00100000:2.0:1776187967.874361:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080ece517 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+435:11406:x1862467653413824:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187967.874430:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187967.874458:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a083 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x233:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabd6 expref: 435 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.874482:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cbf7ecf3/0x92b1eb87ee423e69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x233:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3d5e expref: 434 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.874498:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000003e560ac/0x92b1eb87ee41efcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x233:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21a4 expref: 433 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.874511:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e740d19b/0x92b1eb87ee41eed7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x233:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2149 expref: 432 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.874522:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x233:0x0].0x0 (00000000d2b686e5) 00010000:00010000:2.0:1776187967.874535:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187967.874690:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a08a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.874709:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a08a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.874721:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a08a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.874738:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.874752:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.874758:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.875031:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x233:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.875040:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.875047:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187967.875656:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4745, 176 off834824 00000004:00200000:2.0:1776187967.875715:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x233:0x0]: returning size 11776 00000004:00010000:2.0:1776187967.875734:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000080ece517 reply state 000000004b659425 transno 4294975106 ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.875774:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a08a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.875781:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a08a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.875787:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a08a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.875797:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092776876 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.875801:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a08a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.875807:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a08a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.875819:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:2.0:1776187967.875822:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.875826:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a08a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.875832:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a08a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187967.875922:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000080ece517 reply state 000000004b659425 transno 4294975106 ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187967.876196:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080ece517 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11406:x1862467653413824:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1832us (2024us total) trans 4294975106 rc 0/0 00000100:00100000:2.0:1776187967.876205:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15388 00010000:00010000:3.0:1776187967.879369:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879398:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879406:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879418:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8111509 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.879423:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879430:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879456:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0xf17aab4e (00000000d80c9c1b) 00010000:00010000:3.0:1776187967.879460:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.879465:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879471:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a091 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879488:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879493:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879499:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879515:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.879518:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879523:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879530:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x233:0x0].0x0 (000000007659c27e) 00010000:00010000:3.0:1776187967.879532:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187967.879534:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.879538:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a098 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x233:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187967.881333:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.881427:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413888 00000100:00100000:2.0:1776187967.881492:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15389 00000100:00100000:2.0:1776187967.881499:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d560593c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11406:x1862467653413888:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187967.881523:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.881544:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a09f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabdd expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.881608:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a0a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.881623:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.881633:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187967.881698:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x202:0x0]: returning size 11776 00000004:00200000:2.0:1776187967.881702:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187967.881727:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a0a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.881754:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a09f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabdd expref: 434 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.881769:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a0a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x202:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabdd expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.881776:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:2.0:1776187967.881778:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187967.881781:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000025e5acf1, rc 0) 00000100:00100000:2.0:1776187967.881844:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d560593c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11406:x1862467653413888:12345-192.168.204.20@tcp:101:rm.0 Request processed in 344us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.881851:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15389 00000100:00100000:0.0:1776187967.890363:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.891299:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653413952 00000100:00100000:2.0:1776187967.891365:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4490 00000100:00100000:2.0:1776187967.891789:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004376936e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11406:x1862467653413952:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187967.899118:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004376936e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11406:x1862467653413952:12345-192.168.204.20@tcp:37:rm.0 Request processed in 7326us (8763us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.899135:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4490 00000100:00100000:0.0:1776187967.904870:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.906300:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653414080 00000100:00100000:2.0:1776187967.906594:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4491 00000100:00100000:2.0:1776187967.906601:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006664302e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11406:x1862467653414080:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187967.907051:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006664302e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653414080:12345-192.168.204.20@tcp:35:rm.0 Request processed in 447us (2189us total) trans 4294975107 rc 0/0 00000100:00100000:2.0:1776187967.907064:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4491 00000100:00100000:0.0:1776187967.911324:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.911778:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653414208 00000100:00100000:1.0:1776187967.911841:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15390 00000100:00100000:1.0:1776187967.911848:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009cba992e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+434:11406:x1862467653414208:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:1.0:1776187967.911925:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187967.911953:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a0a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x202:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabdd expref: 434 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.911977:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000062af5947/0x92b1eb87ee421b46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x202:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c31f7 expref: 433 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.911988:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000cc06c86/0x92b1eb87ee41dba5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x202:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1993 expref: 432 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.911998:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eb3fe2b6/0x92b1eb87ee41dac5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x202:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c193f expref: 431 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.912007:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000f996c994) 00010000:00010000:1.0:1776187967.912016:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:0.0:1776187967.912030:0:6809:0:(osp_sync.c:1658:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 444896154318ns, next at 445896151805ns, rc = 0 00010000:00010000:1.0:1776187967.912046:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.912061:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.912070:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.912088:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.912095:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.912101:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187967.912104:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b7a5e45b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659897280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1776187967.912167:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1776187967.912241:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x202:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.912249:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.912256:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187967.912271:0:6331:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897280 00000100:00100000:0.0:1776187967.912305:0:6331:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1776187967.912309:0:6331:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077510bc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2996:x1862467659897280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1776187967.912338:0:6331:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 18743296 granted 177143808 pending 0 free 3834642432 avail 3832545280 00000100:00100000:0.0:1776187967.912379:0:6331:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077510bc1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2996:x1862467659897280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187967.912392:0:6331:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1776187967.912568:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b7a5e45b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659897280:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1776187967.913019:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4746, 176 off835000 00000004:00200000:1.0:1776187967.913071:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x202:0x0]: returning size 11776 00000004:00010000:1.0:1776187967.913085:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009cba992e reply state 0000000063c8c062 transno 4294975108 ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.913131:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.913138:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.913150:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.913157:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.913160:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.913167:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.913185:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:1.0:1776187967.913188:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.913191:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.913196:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187967.913204:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000009cba992e reply state 0000000063c8c062 transno 4294975108 ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.913272:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009cba992e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11406:x1862467653414208:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1422us (1966us total) trans 4294975108 rc 0/0 00000100:00100000:1.0:1776187967.913279:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15390 00000100:00100000:0.0:1776187967.916818:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187967.916933:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.916948:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.916955:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.916960:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cea3a6c8 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.916965:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.916972:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.916989:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x9e0a5f7e (00000000194664fe) 00010000:00010000:3.0:1776187967.916993:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1776187967.916996:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653414272 00010000:00010000:3.0:1776187967.916997:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.917005:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a0b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.917026:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.917031:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.917036:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.917041:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d719b35a already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.917043:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.917049:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.917057:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x202:0x0].0x0 (00000000e5f011d9) 00000100:00100000:2.0:1776187967.917058:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15391 00010000:00010000:3.0:1776187967.917061:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187967.917064:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187967.917069:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9a365fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11406:x1862467653414272:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1776187967.917078:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a0bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x202:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.917243:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187967.917262:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a0c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabe4 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.917326:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a0c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.917342:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.917351:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187967.917485:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x26e:0x0]: returning size 11776 00000004:00200000:2.0:1776187967.917489:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187967.917513:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a0c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.917540:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a0c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabe4 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.917555:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a0c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabe4 expref: 432 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.917561:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26e:0x0].0x0 (0000000062f492a7) 00010000:00010000:2.0:1776187967.917563:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187967.917566:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092776876, rc 0) 00000100:00100000:2.0:1776187967.917672:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9a365fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11406:x1862467653414272:12345-192.168.204.20@tcp:101:rm.0 Request processed in 604us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.917680:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15391 00000100:00100000:3.0:1776187967.922528:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.922804:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653414336 00000100:00100000:2.0:1776187967.922935:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4492 00000100:00100000:2.0:1776187967.922942:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e0ebc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11406:x1862467653414336:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187967.928677:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e0ebc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11406:x1862467653414336:12345-192.168.204.20@tcp:37:rm.0 Request processed in 5725us (6147us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187967.928694:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4492 00000100:00100000:0.0:1776187967.932561:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.933087:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653414464 00000100:00100000:2.0:1776187967.933144:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4493 00000100:00100000:2.0:1776187967.933151:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c01fecec pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11406:x1862467653414464:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187967.933565:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c01fecec pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11406:x1862467653414464:12345-192.168.204.20@tcp:35:rm.0 Request processed in 413us (1011us total) trans 4294975109 rc 0/0 00000100:00100000:2.0:1776187967.933574:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4493 00000100:00100000:3.0:1776187967.936014:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.936524:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653414592 00000100:00100000:3.0:1776187967.936964:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15392 00000100:00100000:3.0:1776187967.936980:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009726b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+433:11406:x1862467653414592:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1776187967.937036:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187967.937061:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a0c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabe4 expref: 433 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937082:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d0bdefb4/0x92b1eb87ee42f9b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c7d30 expref: 432 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937094:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000898bb069/0x92b1eb87ee42750b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4f47 expref: 431 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937104:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000018477079/0x92b1eb87ee42062a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ac6 expref: 430 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937114:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26e:0x0].0x0 (0000000062f492a7) 00010000:00010000:3.0:1776187967.937124:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187967.937154:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a0d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937168:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a0d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937188:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a0d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937208:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937215:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937221:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937347:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937355:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.937361:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187967.938019:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4747, 176 off835176 00000004:00200000:3.0:1776187967.938073:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x26e:0x0]: returning size 11776 00000004:00010000:3.0:1776187967.938088:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000009726b67 reply state 00000000a56fab9d transno 4294975110 ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.938126:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a0d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.938133:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a0d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.938144:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a0d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.938149:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007dfea8c8 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187967.938153:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a0d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.938159:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a0d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.938169:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:3.0:1776187967.938181:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187967.938185:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a0d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187967.938191:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a0d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187967.938199:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000009726b67 reply state 00000000a56fab9d transno 4294975110 ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187967.938455:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009726b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+431:11406:x1862467653414592:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1464us (2439us total) trans 4294975110 rc 0/0 00000100:00100000:3.0:1776187967.938465:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15392 00010000:00010000:1.0:1776187967.941539:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941560:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941567:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941573:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000503e410b already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.941577:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941584:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941601:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x106120ec (00000000adef1ff2) 00010000:00010000:1.0:1776187967.941604:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.941608:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941614:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000503e410b/0x92b1eb87ee43a0d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941635:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941731:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941738:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941743:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000011059098 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.941745:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941751:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941759:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26e:0x0].0x0 (00000000d2ce93fe) 00010000:00010000:1.0:1776187967.941761:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187967.941763:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.941768:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000011059098/0x92b1eb87ee43a0de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x26e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187967.945214:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.945644:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653414656 00000100:00100000:0.0:1776187967.945698:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15393 00000100:00100000:0.0:1776187967.945704:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d28f60a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+430:11406:x1862467653414656:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1776187967.945727:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187967.945749:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a0e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabeb expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.945804:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a0ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x272:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.945820:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a0ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.945831:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a0ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1776187967.945916:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x272:0x0]: returning size 11776 00000004:00200000:0.0:1776187967.945921:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187967.945941:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a0ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.945965:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a0e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabeb expref: 432 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.945988:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a0ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x272:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabeb expref: 431 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187967.945995:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x0 (00000000ed7fe374) 00010000:00010000:0.0:1776187967.945998:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1776187967.946001:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d612a45d, rc 0) 00000100:00100000:0.0:1776187967.946045:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d28f60a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+431:11406:x1862467653414656:12345-192.168.204.20@tcp:101:rm.0 Request processed in 341us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187967.946051:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15393 00000100:00100000:3.0:1776187967.952813:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.952919:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653414720 00000100:00100000:1.0:1776187967.952982:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4494 00000100:00100000:1.0:1776187967.952989:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e9f160d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+431:11406:x1862467653414720:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:1.0:1776187967.964682:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e9f160d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+431:11406:x1862467653414720:12345-192.168.204.20@tcp:37:rm.0 Request processed in 11683us (11867us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187967.964700:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4494 00000100:00100000:3.0:1776187967.970617:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.971322:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653414848 00000100:00100000:1.0:1776187967.971391:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4495 00000100:00100000:1.0:1776187967.971398:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e0f0926 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+431:11406:x1862467653414848:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:1.0:1776187967.972737:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e0f0926 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11406:x1862467653414848:12345-192.168.204.20@tcp:35:rm.0 Request processed in 1331us (2124us total) trans 4294975111 rc 0/0 00000100:00100000:1.0:1776187967.972751:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4495 00000100:00100000:0.0:1776187967.977397:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187967.980525:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653414976 00000100:00100000:1.0:1776187967.980657:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15394 00000100:00100000:1.0:1776187967.980663:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7a5e45b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+432:11406:x1862467653414976:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:1.0:1776187967.980720:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187967.980747:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a0ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x272:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabeb expref: 432 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.980770:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000005ba5257/0x92b1eb87ee4290da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x272:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c5973 expref: 431 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.980783:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007eea5da2/0x92b1eb87ee420899 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x272:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2bad expref: 430 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.980795:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009d989bae/0x92b1eb87ee4207b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x272:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b59 expref: 429 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.980804:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x0 (00000000ed7fe374) 00010000:00010000:1.0:1776187967.980813:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187967.980845:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.980859:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.980869:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.980922:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.980929:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.980940:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.981051:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x272:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.981059:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x272:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.981065:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x272:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187967.982140:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4748, 176 off835352 00000004:00200000:1.0:1776187967.982218:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x272:0x0]: returning size 11776 00000004:00010000:1.0:1776187967.982234:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b7a5e45b reply state 00000000736ffbca transno 4294975112 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x272:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.982274:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.982281:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.982288:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.982294:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.982297:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.982367:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.982381:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:1.0:1776187967.982384:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.982388:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.982394:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a0f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187967.982403:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000b7a5e45b reply state 00000000736ffbca transno 4294975112 ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.982558:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7a5e45b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+430:11406:x1862467653414976:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1892us (5249us total) trans 4294975112 rc 0/0 00000100:00100000:1.0:1776187967.982567:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15394 00010000:00010000:2.0:1776187967.985399:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985417:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985424:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985430:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dce30c64 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.985434:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985451:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985465:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x2c71d537 (000000007842f307) 00010000:00010000:2.0:1776187967.985468:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187967.985472:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985477:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a0fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f5:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985497:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x272:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985503:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x272:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985508:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x272:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985513:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4841773 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187967.985515:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x272:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985520:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x272:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985529:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x272:0x0].0x0 (000000008d2350fb) 00010000:00010000:2.0:1776187967.985531:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187967.985533:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x272:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187967.985537:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a101 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x272:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187967.986862:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187967.987604:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653415104 00000100:00100000:2.0:1776187967.987674:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4496 00000100:00100000:2.0:1776187967.987682:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d32e20f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+429:11406:x1862467653415104:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187967.988109:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d32e20f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+430:11406:x1862467653415104:12345-192.168.204.20@tcp:35:rm.0 Request processed in 426us (1253us total) trans 4294975113 rc 0/0 00000100:00100000:2.0:1776187967.988117:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4496 00000100:00100000:3.0:1776187967.992074:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187967.993145:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653415232 00000100:00100000:1.0:1776187967.993306:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15395 00000100:00100000:1.0:1776187967.993327:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e06687 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+430:11406:x1862467653415232:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:1.0:1776187967.993401:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187967.993429:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000353ab573/0x92b1eb87ee41e4e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d3d expref: 430 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993465:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b23b482b/0x92b1eb87ee421255 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2f18 expref: 429 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993481:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a561b95e/0x92b1eb87ee41da4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1915 expref: 428 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993493:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (000000005cef707e) 00010000:00010000:1.0:1776187967.993511:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee439faa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caba5 expref: 427 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993519:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (00000000cf81227d) 00010000:00010000:1.0:1776187967.993522:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187967.993558:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a108 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993574:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a108 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993582:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a108 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993596:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993602:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993608:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993737:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993745:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.993755:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187967.994793:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4749, 176 off835528 00000004:00200000:1.0:1776187967.994854:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f5:0x0]: returning size 11776 00000004:00010000:1.0:1776187967.994870:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000059e06687 reply state 00000000588e593b transno 4294975114 ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.994942:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a108 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.994949:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a108 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.994954:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a108 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.994960:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.994963:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a108 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.995189:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a108 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.995207:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (00000000cf81227d) 00010000:00010000:1.0:1776187967.995210:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.995214:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a108 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.995225:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a108 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187967.995235:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000059e06687 reply state 00000000588e593b transno 4294975114 ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187967.995547:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e06687 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+428:11406:x1862467653415232:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2218us (3479us total) trans 4294975114 rc 0/0 00000100:00100000:1.0:1776187967.995557:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15395 00000100:00100000:3.0:1776187967.999650:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1776187967.999727:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999744:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999752:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999759:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000474fd8b4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.999763:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999770:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999786:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0xfe8990f0 (00000000f056c6a6) 00010000:00010000:1.0:1776187967.999789:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187967.999792:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999799:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a10f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f3:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999822:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999829:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999834:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999839:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0ab918b already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187967.999842:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999847:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999855:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f5:0x0].0x0 (00000000eb7ad866) 00010000:00010000:1.0:1776187967.999857:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187967.999859:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187967.999864:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a116 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.001834:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653415360 00000100:00100000:2.0:1776187968.002007:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4497 00000100:00100000:2.0:1776187968.002015:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e0ebc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+427:11406:x1862467653415360:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187968.002848:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e0ebc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+428:11406:x1862467653415360:12345-192.168.204.20@tcp:35:rm.0 Request processed in 830us (3211us total) trans 4294975115 rc 0/0 00000100:00100000:2.0:1776187968.002859:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4497 00000100:00100000:3.0:1776187968.006045:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.007090:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653415488 00000100:00100000:2.0:1776187968.007271:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15396 00000100:00100000:2.0:1776187968.007279:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e9f160d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+428:11406:x1862467653415488:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187968.007364:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187968.007393:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005bae4e37/0x92b1eb87ee42110c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ea8 expref: 428 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007415:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000eb376e96/0x92b1eb87ee41d523 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f3:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c170f expref: 427 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007426:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001a9813fe/0x92b1eb87ee41d489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c16e5 expref: 426 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007435:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (00000000cf81227d) 00010000:00010000:2.0:1776187968.007461:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d26d87db/0x92b1eb87ee439f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab90 expref: 425 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007472:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (000000003d48dd25) 00010000:00010000:2.0:1776187968.007474:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.007511:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a11d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007525:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a11d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007539:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a11d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007552:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007558:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007565:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007685:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007693:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.007700:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187968.009816:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4751, 176 off835760 00000004:00200000:2.0:1776187968.010212:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f3:0x0]: returning size 11776 00000004:00010000:2.0:1776187968.010229:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004e9f160d reply state 0000000018b71a33 transno 4294975116 ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.010280:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a11d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.010288:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a11d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.010295:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a11d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.010301:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d47697e3 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.010305:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a11d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.010321:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a11d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.010338:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (000000003d48dd25) 00010000:00010000:2.0:1776187968.010340:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.010433:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a11d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.010526:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a11d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187968.010539:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004e9f160d reply state 0000000018b71a33 transno 4294975116 ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.010695:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e9f160d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+426:11406:x1862467653415488:12345-192.168.204.20@tcp:36:rm.0 Request processed in 3414us (4821us total) trans 4294975116 rc 0/0 00000100:00100000:2.0:1776187968.010705:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15396 00010000:00010000:3.0:1776187968.024194:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024214:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024222:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024229:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089fb6120 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.024233:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024240:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024259:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0xf138ac0d (000000007e00579b) 00010000:00010000:3.0:1776187968.024261:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.024265:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024271:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a124 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f1:0x0].0xf138ac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024288:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024292:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024298:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024302:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfd2bd90 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.024303:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024307:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024323:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f3:0x0].0x0 (000000007659c27e) 00010000:00010000:3.0:1776187968.024325:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187968.024327:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.024332:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a12b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.025659:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.026313:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653415552 00000100:00100000:2.0:1776187968.026379:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4498 00000100:00100000:2.0:1776187968.026385:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e0f0926 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+425:11406:x1862467653415552:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187968.032616:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e0f0926 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+425:11406:x1862467653415552:12345-192.168.204.20@tcp:37:rm.0 Request processed in 6221us (6955us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.032632:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4498 00000100:00100000:3.0:1776187968.039817:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.040014:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653415616 00000100:00100000:2.0:1776187968.040077:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4499 00000100:00100000:2.0:1776187968.040084:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe5c9b61 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+425:11406:x1862467653415616:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187968.046274:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe5c9b61 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+425:11406:x1862467653415616:12345-192.168.204.20@tcp:37:rm.0 Request processed in 6181us (6459us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.046290:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4499 00000100:00100000:1.0:1776187968.051503:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.051614:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653415680 00000100:00100000:2.0:1776187968.051677:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15397 00000100:00100000:2.0:1776187968.051683:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000714c2236 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+425:11406:x1862467653415680:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187968.051705:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187968.051727:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a132 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabf2 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.051789:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x234:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.051804:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x234:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.051814:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x234:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187968.051911:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x234:0x0]: returning size 11776 00000004:00200000:2.0:1776187968.051916:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187968.051941:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x234:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.051978:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a132 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabf2 expref: 427 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.051996:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x234:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabf2 expref: 426 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.052005:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x234:0x0].0x0 (0000000044964d16) 00010000:00010000:2.0:1776187968.052008:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187968.052011:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000001be7b27e, rc 0) 00000100:00100000:2.0:1776187968.052079:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000714c2236 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+426:11406:x1862467653415680:12345-192.168.204.20@tcp:101:rm.0 Request processed in 394us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.052086:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15397 00000100:00100000:3.0:1776187968.057799:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.058000:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653415744 00000100:00100000:2.0:1776187968.058058:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4500 00000100:00100000:2.0:1776187968.058065:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009157d9b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+426:11406:x1862467653415744:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187968.062792:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009157d9b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+426:11406:x1862467653415744:12345-192.168.204.20@tcp:37:rm.0 Request processed in 4714us (4990us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.062807:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4500 00000100:00100000:3.0:1776187968.067990:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.068265:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653415872 00000100:00100000:2.0:1776187968.068377:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4501 00000100:00100000:2.0:1776187968.068384:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a420d17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+426:11406:x1862467653415872:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187968.069050:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a420d17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+427:11406:x1862467653415872:12345-192.168.204.20@tcp:35:rm.0 Request processed in 663us (1065us total) trans 4294975117 rc 0/0 00000100:00100000:2.0:1776187968.069059:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4501 00000100:00100000:0.0:1776187968.072086:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.072193:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416000 00000100:00100000:3.0:1776187968.072256:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15398 00000100:00100000:3.0:1776187968.072263:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d71b17f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+427:11406:x1862467653416000:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1776187968.072329:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1776187968.072358:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x234:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabf2 expref: 427 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072384:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008c2504e8/0x92b1eb87ee423f11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x234:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3d96 expref: 426 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072397:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000049cb023c/0x92b1eb87ee41f00b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x234:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21b9 expref: 425 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072407:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000013cd4df6/0x92b1eb87ee41ef5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x234:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2173 expref: 424 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072418:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x234:0x0].0x0 (0000000044964d16) 00010000:00010000:3.0:1776187968.072434:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006091940d/0x92b1eb87ee420a36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c5c expref: 423 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072442:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:3.0:1776187968.072445:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187968.072476:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a140 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072489:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072498:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072512:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072519:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072526:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072654:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x234:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072663:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.072670:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187968.073149:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4752, 176 off835936 00000004:00200000:3.0:1776187968.073207:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x234:0x0]: returning size 11776 00000004:00010000:3.0:1776187968.073221:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004d71b17f reply state 000000005028e97a transno 4294975118 ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.073255:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a140 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.073262:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a140 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.073268:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a140 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.073274:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007dfea8c8 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.073277:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a140 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.073287:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a140 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.073296:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:3.0:1776187968.073298:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.073301:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a140 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.073306:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a140 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187968.073314:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004d71b17f reply state 000000005028e97a transno 4294975118 ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.073393:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d71b17f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+424:11406:x1862467653416000:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1129us (1314us total) trans 4294975118 rc 0/0 00000100:00100000:3.0:1776187968.073402:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15398 00010000:00010000:1.0:1776187968.076544:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076559:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076564:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076569:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000752cecf8 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.076572:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076584:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076598:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0xf17aab4e (000000005aa30e07) 00010000:00010000:1.0:1776187968.076601:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187968.076604:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076608:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000752cecf8/0x92b1eb87ee43a147 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0xf17aab4e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076622:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076625:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076628:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076632:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ba32a0cd already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.076634:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076637:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076640:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x234:0x0].0x0 (000000003846d7f8) 00010000:00010000:1.0:1776187968.076641:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187968.076642:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.076645:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ba32a0cd/0x92b1eb87ee43a14e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x234:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.077616:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.078203:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416064 00000100:00100000:2.0:1776187968.078261:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15399 00000100:00100000:2.0:1776187968.078267:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b2b6ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+423:11406:x1862467653416064:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187968.078292:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187968.078324:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a155 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cabf9 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.078384:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a15c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.078398:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a15c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.078410:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a15c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187968.078474:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x26d:0x0]: returning size 11776 00000004:00200000:2.0:1776187968.078478:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187968.078501:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a15c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.078526:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a155 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabf9 expref: 425 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.078541:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a15c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabf9 expref: 424 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.078549:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26d:0x0].0x0 (000000001ecff654) 00010000:00010000:2.0:1776187968.078552:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187968.078555:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002df099c7, rc 0) 00000100:00100000:2.0:1776187968.078617:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b2b6ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+424:11406:x1862467653416064:12345-192.168.204.20@tcp:101:rm.0 Request processed in 348us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.078625:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15399 00000100:00100000:3.0:1776187968.084193:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.084297:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416128 00000100:00100000:2.0:1776187968.084361:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4502 00000100:00100000:2.0:1776187968.084368:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e13c69aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+424:11406:x1862467653416128:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187968.089110:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e13c69aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+424:11406:x1862467653416128:12345-192.168.204.20@tcp:37:rm.0 Request processed in 4735us (4918us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.089127:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4502 00000100:00100000:3.0:1776187968.093493:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.093755:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416256 00000100:00100000:2.0:1776187968.093856:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4503 00000100:00100000:2.0:1776187968.093865:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7aa3d8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+424:11406:x1862467653416256:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187968.094747:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7aa3d8e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+425:11406:x1862467653416256:12345-192.168.204.20@tcp:35:rm.0 Request processed in 879us (1258us total) trans 4294975119 rc 0/0 00000100:00100000:2.0:1776187968.094757:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4503 00000100:00100000:0.0:1776187968.097691:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.097761:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416384 00000100:00100000:3.0:1776187968.097818:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15400 00000100:00100000:3.0:1776187968.097824:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004376936e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+425:11406:x1862467653416384:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1776187968.098237:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187968.098274:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a15c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabf9 expref: 425 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098305:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000084fc157f/0x92b1eb87ee42f526 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c7baf expref: 424 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098566:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000034d57713/0x92b1eb87ee427463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x26d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c4f1d expref: 423 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098625:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006e677566/0x92b1eb87ee4205b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x26d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2aa3 expref: 422 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098633:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26d:0x0].0x0 (000000001ecff654) 00010000:00010000:3.0:1776187968.098643:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187968.098675:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a163 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098689:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a163 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098699:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a163 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098713:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098720:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098725:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098854:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098867:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.098892:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187968.099840:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4753, 176 off836112 00000004:00200000:3.0:1776187968.099943:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x26d:0x0]: returning size 11776 00000004:00010000:3.0:1776187968.099960:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004376936e reply state 0000000049ac1d1e transno 4294975120 ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.100002:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a163 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.100010:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a163 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.100016:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a163 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.100022:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007dfea8c8 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.100026:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a163 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.100033:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a163 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.100046:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:3.0:1776187968.100049:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.100052:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a163 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.100058:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a163 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187968.100066:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000004376936e reply state 0000000049ac1d1e transno 4294975120 ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.100186:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004376936e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+423:11406:x1862467653416384:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2359us (2498us total) trans 4294975120 rc 0/0 00000100:00100000:3.0:1776187968.100195:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15400 00010000:00010000:2.0:1776187968.102844:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.102863:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.102871:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.102906:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.102948:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416448 00000100:00100000:0.0:1776187968.103019:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15401 00000100:00100000:0.0:1776187968.103025:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5133036 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+423:11406:x1862467653416448:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1776187968.103049:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187968.103067:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac00 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.103125:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a17f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.103140:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.103152:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1776187968.103223:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x21b:0x0]: returning size 12800 00000004:00200000:0.0:1776187968.103227:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187968.103254:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a17f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.103281:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac00 expref: 425 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.103298:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a17f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac00 expref: 424 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.103307:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:0.0:1776187968.103310:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1776187968.103313:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a9283777, rc 0) 00000100:00100000:0.0:1776187968.103378:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5133036 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+424:11406:x1862467653416448:12345-192.168.204.20@tcp:101:rm.0 Request processed in 351us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.103385:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15401 00010000:00010000:2.0:1776187968.103442:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c2e5f2ee already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.103445:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.103453:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.103463:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x106120ec (000000006f67d5a2) 00010000:00010000:2.0:1776187968.103466:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.103469:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.103474:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c2e5f2ee/0x92b1eb87ee43a16a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x106120ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.103487:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.103493:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.103499:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.103504:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000052d92773 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.103506:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.103512:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.103519:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x26d:0x0].0x0 (0000000037029ea1) 00010000:00010000:2.0:1776187968.103521:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187968.103523:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.103528:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000052d92773/0x92b1eb87ee43a171 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x26d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.109758:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.109932:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416512 00000100:00100000:2.0:1776187968.109990:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4504 00000100:00100000:2.0:1776187968.109997:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fffd3274 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+423:11406:x1862467653416512:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:3.0:1776187968.122024:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fffd3274 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+423:11406:x1862467653416512:12345-192.168.204.20@tcp:37:rm.0 Request processed in 11485us (11736us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.122042:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4504 00000100:00100000:3.0:1776187968.127850:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.130869:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416640 00000100:00100000:0.0:1776187968.130941:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4505 00000100:00100000:0.0:1776187968.130948:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcbe5f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+423:11406:x1862467653416640:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:0.0:1776187968.131699:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcbe5f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+424:11406:x1862467653416640:12345-192.168.204.20@tcp:35:rm.0 Request processed in 749us (3856us total) trans 4294975121 rc 0/0 00000100:00100000:0.0:1776187968.131710:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4505 00000100:00100000:1.0:1776187968.134376:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.134721:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416768 00000100:00100000:2.0:1776187968.134834:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15402 00000100:00100000:2.0:1776187968.134842:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db4ef2c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+424:11406:x1862467653416768:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187968.134913:0:5516:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187968.134939:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a17f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac00 expref: 424 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.134963:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000165c80b/0x92b1eb87ee422c25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c377d expref: 423 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.134975:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c8d32b5a/0x92b1eb87ee41e664 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x21b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1dc2 expref: 422 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.134985:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003eef29f7/0x92b1eb87ee41e5ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x21b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d7c expref: 421 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.134994:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (00000000c65ef29a) 00010000:00010000:2.0:1776187968.135006:0:5516:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.135041:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a186 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.135057:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.135066:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.135080:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.135087:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.135093:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.135325:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.135333:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.135340:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187968.137011:0:5516:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4754, 176 off836288 00000004:00200000:2.0:1776187968.137103:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x21b:0x0]: returning size 12800 00000004:00010000:2.0:1776187968.137121:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000db4ef2c4 reply state 0000000004184517 transno 4294975122 ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.137183:0:5516:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a186 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.137192:0:5516:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a186 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.137199:0:5516:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a186 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.137205:0:5516:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d47697e3 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.137209:0:5516:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a186 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.137217:0:5516:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a186 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.137230:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:2.0:1776187968.137232:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.137236:0:5516:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a186 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.137242:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a186 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187968.137251:0:5516:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000db4ef2c4 reply state 0000000004184517 transno 4294975122 ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.137363:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db4ef2c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+422:11406:x1862467653416768:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2518us (3051us total) trans 4294975122 rc 0/0 00000100:00100000:2.0:1776187968.137373:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15402 00010000:00010000:1.0:1776187968.139863:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.139908:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.139915:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.139922:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000082c8d05e already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.139926:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.139934:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.139948:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x8cffc40b (00000000d80c9c1b) 00010000:00010000:1.0:1776187968.139951:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187968.139954:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.139960:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000082c8d05e/0x92b1eb87ee43a18d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x8cffc40b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.139979:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.139985:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.139991:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.139996:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000b7eaa4a already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.139999:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.140005:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.140011:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x21b:0x0].0x0 (0000000090869b29) 00010000:00010000:1.0:1776187968.140014:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187968.140016:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.140022:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000b7eaa4a/0x92b1eb87ee43a194 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x21b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.142979:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.143491:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416832 00000100:00100000:2.0:1776187968.143554:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15403 00000100:00100000:2.0:1776187968.143560:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a4c9a23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+421:11406:x1862467653416832:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187968.143594:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187968.143616:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a19b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac07 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.143685:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a1a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x23b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.143700:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.143711:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187968.143770:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23b:0x0]: returning size 11776 00000004:00200000:2.0:1776187968.143773:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187968.143794:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a1a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x23b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.143821:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a19b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac07 expref: 423 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.143841:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a1a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x23b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac07 expref: 422 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.143850:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23b:0x0].0x0 (000000000554bd3e) 00010000:00010000:2.0:1776187968.143852:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187968.143855:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002df099c7, rc 0) 00000100:00100000:2.0:1776187968.143945:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a4c9a23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+422:11406:x1862467653416832:12345-192.168.204.20@tcp:101:rm.0 Request processed in 384us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.143952:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15403 00000100:00100000:0.0:1776187968.153239:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.153502:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653416896 00000100:00100000:1.0:1776187968.153559:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4506 00000100:00100000:1.0:1776187968.153572:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006dd5cf62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+422:11406:x1862467653416896:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:1.0:1776187968.163496:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006dd5cf62 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+422:11406:x1862467653416896:12345-192.168.204.20@tcp:37:rm.0 Request processed in 9919us (10257us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.163516:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4506 00000100:00100000:0.0:1776187968.168294:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.168484:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417024 00000100:00100000:1.0:1776187968.168538:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4507 00000100:00100000:1.0:1776187968.168545:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000346ea37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+422:11406:x1862467653417024:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:1.0:1776187968.169265:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000346ea37 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+423:11406:x1862467653417024:12345-192.168.204.20@tcp:35:rm.0 Request processed in 716us (974us total) trans 4294975123 rc 0/0 00000100:00100000:1.0:1776187968.169275:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4507 00000100:00100000:1.0:1776187968.173187:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.173299:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417152 00000100:00100000:0.0:1776187968.173438:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15404 00000100:00100000:0.0:1776187968.173444:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fffd3274 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+423:11406:x1862467653417152:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:0.0:1776187968.173496:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187968.173520:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002df099c7/0x92b1eb87ee43a1a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac07 expref: 423 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.173541:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000e34d10c/0x92b1eb87ee424474 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c3f48 expref: 422 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.173553:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005aece7be/0x92b1eb87ee41f345 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23b:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22ed expref: 421 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.173805:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002267d059/0x92b1eb87ee41f25e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x23b:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22a0 expref: 420 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.173818:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23b:0x0].0x0 (000000000554bd3e) 00010000:00010000:0.0:1776187968.173832:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.173867:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a1a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.174160:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a1a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.174185:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a1a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.174395:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.174407:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.174415:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.174525:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.174534:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.174540:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187968.177827:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4755, 176 off836464 00000004:00200000:1.0:1776187968.177921:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x23b:0x0]: returning size 11776 00000004:00010000:1.0:1776187968.177941:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000fffd3274 reply state 00000000a7ffce84 transno 4294975124 ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.178619:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a1a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.178695:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a1a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.178704:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a1a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.178709:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b23405f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.178713:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a1a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.178720:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a1a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.178740:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:1.0:1776187968.178742:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187968.178746:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a1a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.178751:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b23405f4/0x92b1eb87ee43a1a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187968.178761:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000fffd3274 reply state 00000000a7ffce84 transno 4294975124 ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.178859:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fffd3274 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+421:11406:x1862467653417152:12345-192.168.204.20@tcp:36:rm.0 Request processed in 5412us (5689us total) trans 4294975124 rc 0/0 00000100:00100000:1.0:1776187968.178868:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15404 00010000:00010000:3.0:1776187968.181776:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181796:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181802:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181807:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0ab918b already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.181811:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181823:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181838:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x46e192ec (00000000eb7ad866) 00010000:00010000:3.0:1776187968.181840:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.181845:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181850:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a1b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x46e192ec bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181869:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181903:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181909:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181913:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000474fd8b4 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.181915:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181920:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181927:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23b:0x0].0x0 (00000000f056c6a6) 00010000:00010000:3.0:1776187968.181929:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187968.181931:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.181935:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a1b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x23b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.185442:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.186020:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417216 00000100:00100000:3.0:1776187968.186081:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15405 00000100:00100000:3.0:1776187968.186088:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d23e956 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+420:11406:x1862467653417216:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:3.0:1776187968.186114:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187968.186134:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a1be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac0e expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.186217:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a1c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.186233:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.186245:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187968.186434:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20f:0x0]: returning size 11776 00000004:00200000:3.0:1776187968.186439:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1776187968.186468:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.186495:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a1be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac0e expref: 422 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.186513:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac0e expref: 421 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.186521:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000fd67caeb) 00010000:00010000:3.0:1776187968.186524:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1776187968.186528:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007a73b3e2, rc 0) 00000100:00100000:0.0:1776187968.187390:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d23e956 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+421:11406:x1862467653417216:12345-192.168.204.20@tcp:101:rm.0 Request processed in 1297us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.187403:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15405 00000100:00100000:2.0:1776187968.191833:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.191962:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417280 00000100:00100000:1.0:1776187968.192034:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4508 00000100:00100000:1.0:1776187968.192040:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e0ebc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+421:11406:x1862467653417280:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187968.202891:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e0ebc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+421:11406:x1862467653417280:12345-192.168.204.20@tcp:37:rm.0 Request processed in 10830us (11047us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.202906:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4508 00000100:00100000:3.0:1776187968.210623:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.210788:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417408 00000100:00100000:2.0:1776187968.210851:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4509 00000100:00100000:2.0:1776187968.210857:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071c80bbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+421:11406:x1862467653417408:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187968.211536:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071c80bbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+422:11406:x1862467653417408:12345-192.168.204.20@tcp:35:rm.0 Request processed in 676us (921us total) trans 4294975125 rc 0/0 00000100:00100000:2.0:1776187968.211545:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4509 00000100:00100000:1.0:1776187968.218073:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.218299:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417536 00000100:00100000:0.0:1776187968.218424:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15406 00000100:00100000:0.0:1776187968.218432:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c480202 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+422:11406:x1862467653417536:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:0.0:1776187968.218537:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187968.218570:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a1c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac0e expref: 422 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218593:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000128add9d/0x92b1eb87ee4222cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c346d expref: 421 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218605:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005462aaf9/0x92b1eb87ee41e16a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20f:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bca expref: 420 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218619:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f935d60d/0x92b1eb87ee41e0bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b84 expref: 419 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218629:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000fd67caeb) 00010000:00010000:0.0:1776187968.218639:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.218684:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218699:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218712:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218724:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218731:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218738:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218850:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218859:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.218866:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187968.219318:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4756, 176 off836640 00000004:00200000:0.0:1776187968.219365:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20f:0x0]: returning size 11776 00000004:00010000:0.0:1776187968.219378:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000c480202 reply state 00000000a8d0ecf2 transno 4294975126 ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.219415:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.219425:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.219431:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.219436:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007072c805 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187968.219438:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.219445:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.219452:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:0.0:1776187968.219460:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187968.219463:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.219468:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187968.219475:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000000c480202 reply state 00000000a8d0ecf2 transno 4294975126 ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.219548:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c480202 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+420:11406:x1862467653417536:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1115us (1481us total) trans 4294975126 rc 0/0 00000100:00100000:0.0:1776187968.219555:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15406 00010000:00010000:3.0:1776187968.223200:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223223:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223231:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223237:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.223241:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223249:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223266:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0xddbda88f (00000000693f1349) 00010000:00010000:3.0:1776187968.223269:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.223273:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223278:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a1d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0xddbda88f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223307:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223313:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223317:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223321:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d042148c already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.223324:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223329:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223335:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20f:0x0].0x0 (00000000219adb48) 00010000:00010000:3.0:1776187968.223337:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187968.223339:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.223343:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.228654:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.229821:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417600 00000100:00100000:0.0:1776187968.229909:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15407 00000100:00100000:0.0:1776187968.229916:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036115f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+419:11406:x1862467653417600:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1776187968.229945:0:12471:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187968.229969:0:12471:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac15 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.230029:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a1e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.230046:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.230057:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1776187968.230135:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20a:0x0]: returning size 11776 00000004:00200000:0.0:1776187968.230139:0:12471:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187968.230162:0:12471:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.230201:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac15 expref: 421 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.230219:0:12471:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac15 expref: 420 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.230227:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x0 (00000000c45808c0) 00010000:00010000:0.0:1776187968.230230:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1776187968.230233:0:12471:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c08abd94, rc 0) 00000100:00100000:0.0:1776187968.230309:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036115f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+420:11406:x1862467653417600:12345-192.168.204.20@tcp:101:rm.0 Request processed in 391us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.230317:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15407 00000100:00100000:1.0:1776187968.242690:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.243006:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417664 00000100:00100000:2.0:1776187968.243066:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4510 00000100:00100000:2.0:1776187968.243073:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000818d4c03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+420:11406:x1862467653417664:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:2.0:1776187968.249316:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000818d4c03 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+420:11406:x1862467653417664:12345-192.168.204.20@tcp:37:rm.0 Request processed in 6235us (6627us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.249331:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4510 00000100:00100000:1.0:1776187968.256914:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.257128:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417792 00000100:00100000:2.0:1776187968.257191:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4511 00000100:00100000:2.0:1776187968.257198:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002878ddd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+420:11406:x1862467653417792:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187968.257610:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002878ddd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+421:11406:x1862467653417792:12345-192.168.204.20@tcp:35:rm.0 Request processed in 411us (735us total) trans 4294975127 rc 0/0 00000100:00100000:2.0:1776187968.257618:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4511 00000100:00100000:1.0:1776187968.267520:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.269118:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417920 00000100:00100000:0.0:1776187968.269203:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15408 00000100:00100000:0.0:1776187968.269209:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003b43327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+421:11406:x1862467653417920:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:0.0:1776187968.269270:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187968.269299:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a1e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac15 expref: 421 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269320:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000099458273/0x92b1eb87ee42214a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c33ef expref: 420 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269333:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004797aadd/0x92b1eb87ee41deca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x20a:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ace expref: 419 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269343:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005d4046b3/0x92b1eb87ee41de29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x20a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a8f expref: 418 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269352:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x0 (00000000c45808c0) 00010000:00010000:0.0:1776187968.269361:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.269393:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269409:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269418:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269437:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269444:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269449:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269553:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269562:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.269568:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187968.270068:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4757, 176 off836816 00000004:00200000:0.0:1776187968.270123:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x20a:0x0]: returning size 11776 00000004:00010000:0.0:1776187968.270139:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000003b43327 reply state 0000000085ac87fd transno 4294975128 ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.270192:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.270199:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.270211:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.270216:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004fba2add already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187968.270219:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.270226:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.270234:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:0.0:1776187968.270237:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187968.270240:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.270245:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a1ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187968.270251:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000003b43327 reply state 0000000085ac87fd transno 4294975128 ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.270343:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003b43327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+419:11406:x1862467653417920:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1132us (2829us total) trans 4294975128 rc 0/0 00000100:00100000:0.0:1776187968.270351:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15408 00010000:00010000:2.0:1776187968.272930:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.272956:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.272964:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.272970:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007072c805 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.272974:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.272980:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.272994:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0xc144154 (00000000219adb48) 00010000:00010000:2.0:1776187968.272997:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.273000:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.273006:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a1f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0xc144154 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.273025:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.273030:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.273035:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.273045:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d042148c already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.273047:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.273052:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.273057:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x20a:0x0].0x0 (00000000693f1349) 00010000:00010000:2.0:1776187968.273059:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187968.273060:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.273065:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a1fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x20a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.277044:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.277222:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653417984 00000100:00100000:2.0:1776187968.277273:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15409 00000100:00100000:2.0:1776187968.277281:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc7c6b96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11406:x1862467653417984:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:2.0:1776187968.277306:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187968.277329:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a204 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac1c expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.277386:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a20b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.277401:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.277416:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187968.277474:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x243:0x0]: returning size 12800 00000004:00200000:2.0:1776187968.277478:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187968.277501:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a20b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.277526:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac1c expref: 420 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.277542:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a20b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x243:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac1c expref: 419 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.277550:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:2.0:1776187968.277552:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187968.277555:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d47697e3, rc 0) 00000100:00100000:2.0:1776187968.277616:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc7c6b96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+419:11406:x1862467653417984:12345-192.168.204.20@tcp:101:rm.0 Request processed in 335us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.277623:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15409 00000100:00100000:3.0:1776187968.282909:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.282985:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418048 00000100:00100000:1.0:1776187968.283037:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4512 00000100:00100000:1.0:1776187968.283043:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e08d0c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+419:11406:x1862467653418048:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:1.0:1776187968.287644:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e08d0c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+419:11406:x1862467653418048:12345-192.168.204.20@tcp:37:rm.0 Request processed in 4593us (4767us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.287660:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4512 00000100:00100000:3.0:1776187968.291442:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.291721:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418176 00000100:00100000:1.0:1776187968.291783:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4513 00000100:00100000:1.0:1776187968.291790:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e144210c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+419:11406:x1862467653418176:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:1.0:1776187968.293732:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e144210c pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+420:11406:x1862467653418176:12345-192.168.204.20@tcp:35:rm.0 Request processed in 1934us (2290us total) trans 4294975129 rc 0/0 00000100:00100000:1.0:1776187968.293749:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4513 00000100:00100000:3.0:1776187968.299137:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.300124:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418304 00000100:00100000:0.0:1776187968.300202:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15410 00000100:00100000:0.0:1776187968.300209:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041ae9e4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+420:11406:x1862467653418304:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:0.0:1776187968.300271:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1776187968.300413:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d47697e3/0x92b1eb87ee43a20b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x243:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac1c expref: 420 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300443:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f7e0c70b/0x92b1eb87ee424b89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x243:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c41be expref: 419 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300454:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ada815e0/0x92b1eb87ee41f678 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x243:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c242f expref: 418 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300465:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000e3d375a/0x92b1eb87ee41f591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x243:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c23db expref: 417 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300478:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004a61a5f9) 00010000:00010000:0.0:1776187968.300488:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.300523:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a212 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300539:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a212 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300549:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a212 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300562:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300569:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300579:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300794:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x243:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300803:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.300810:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187968.301536:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4758, 176 off836992 00000004:00200000:0.0:1776187968.301592:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x243:0x0]: returning size 12800 00000004:00010000:0.0:1776187968.301608:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000041ae9e4a reply state 00000000aadae57e transno 4294975130 ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.301661:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a212 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.301669:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a212 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.301676:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a212 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.301683:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004fba2add already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187968.301686:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a212 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.301697:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a212 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.301708:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:0.0:1776187968.301711:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187968.301714:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a212 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.301719:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a212 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187968.301727:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000041ae9e4a reply state 00000000aadae57e transno 4294975130 ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.301824:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041ae9e4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11406:x1862467653418304:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1612us (2695us total) trans 4294975130 rc 0/0 00000100:00100000:0.0:1776187968.301833:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15410 00000100:00100000:3.0:1776187968.305913:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.306404:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418368 00000100:00100000:0.0:1776187968.306483:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15411 00000100:00100000:0.0:1776187968.306493:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e92b74b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11414:x1862467653418368:12345-192.168.204.20@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1776187968.307240:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e92b74b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11414:x1862467653418368:12345-192.168.204.20@tcp:501:chlg_load_threa.0 Request processed in 744us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.307249:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15411 00010000:00010000:3.0:1776187968.311380:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311404:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311412:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311418:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c08abd94 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.311423:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311430:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311447:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x56ca4f59 (000000000f4996f9) 00010000:00010000:3.0:1776187968.311450:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.311454:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311460:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a219 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x56ca4f59 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311481:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311487:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311492:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311502:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.311504:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311509:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311516:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x243:0x0].0x0 (000000004c664cf8) 00010000:00010000:3.0:1776187968.311518:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187968.311520:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.311525:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a220 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x243:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.312085:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.312961:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.316130:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418432 00000100:00100000:0.0:1776187968.316256:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418496 00000100:00100000:2.0:1776187968.316769:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15412 00000100:00100000:2.0:1776187968.316779:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020131072 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11414:x1862467653418432:12345-192.168.204.20@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1776187968.316846:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15413 00000100:00100000:1.0:1776187968.316854:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd0dbaa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11406:x1862467653418496:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1776187968.317053:0:5517:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187968.317078:0:5517:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a227 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac23 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.317141:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a22e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.317160:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.317227:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020131072 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+419:11414:x1862467653418432:12345-192.168.204.20@tcp:503:chlg_load_threa.0 Request processed in 447us (5422us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.317236:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15412 00010000:00010000:1.0:1776187968.318390:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1776187968.318461:0:5517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x201:0x0]: returning size 11776 00000004:00200000:1.0:1776187968.318466:0:5517:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1776187968.318492:0:5517:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a22e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.318526:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a227 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac23 expref: 419 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.318544:0:5517:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a22e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x201:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac23 expref: 418 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.318552:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:1.0:1776187968.318555:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1776187968.318558:0:5517:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e5979b39, rc 0) 00000100:00100000:1.0:1776187968.318617:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd0dbaa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11406:x1862467653418496:12345-192.168.204.20@tcp:101:rm.0 Request processed in 1762us (5658us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.318625:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15413 00000100:00100000:1.0:1776187968.346006:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.346047:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.346161:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418560 00000100:00100000:0.0:1776187968.346228:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15414 00000100:00100000:0.0:1776187968.346234:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006789db94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11414:x1862467653418560:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187968.346503:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006789db94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11414:x1862467653418560:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 268us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.346511:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15414 00000100:00100000:2.0:1776187968.347126:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418624 00000100:00100000:2.0:1776187968.347174:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4514 00000100:00100000:2.0:1776187968.347179:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000617a485f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11406:x1862467653418624:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:3.0:1776187968.349575:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.350974:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418688 00000100:00100000:2.0:1776187968.351090:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15415 00000100:00100000:2.0:1776187968.351097:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000280743fd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+420:11414:x1862467653418688:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.351374:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000280743fd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+420:11414:x1862467653418688:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 276us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.351383:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15415 00000100:00100000:1.0:1776187968.357521:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000617a485f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11406:x1862467653418624:12345-192.168.204.20@tcp:37:rm.0 Request processed in 10332us (11465us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.357537:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4514 00000100:00100000:3.0:1776187968.358578:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.368344:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.370001:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418752 00010000:00010000:0.0:1776187968.370029:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.370928:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15416 00000100:00100000:1.0:1776187968.370937:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f17c2333 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11414:x1862467653418752:12345-192.168.204.20@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1776187968.371056:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f17c2333 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11414:x1862467653418752:12345-192.168.204.20@tcp:501:chlg_load_threa.0 Request processed in 119us (12481us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.371063:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15416 00000100:00100000:1.0:1776187968.371098:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653418880 00000100:00100000:1.0:1776187968.371126:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4515 00000100:00100000:1.0:1776187968.371131:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082dfa6ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11406:x1862467653418880:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:1.0:1776187968.371462:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082dfa6ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+419:11406:x1862467653418880:12345-192.168.204.20@tcp:35:rm.0 Request processed in 329us (3125us total) trans 4294975131 rc 0/0 00000100:00100000:1.0:1776187968.371469:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4515 00000100:00100000:3.0:1776187968.377293:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.377382:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419008 00000100:00100000:2.0:1776187968.377434:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15417 00000100:00100000:2.0:1776187968.377442:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000007aa6988 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+419:11406:x1862467653419008:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187968.377492:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187968.377518:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a22e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac23 expref: 419 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.377542:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004907b138/0x92b1eb87ee421a82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c31b1 expref: 418 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.377553:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000016cb70ec/0x92b1eb87ee41db66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x201:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c197e expref: 417 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.377563:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a6997c94/0x92b1eb87ee41da9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x201:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c192a expref: 416 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.377573:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000006b749e86) 00010000:00010000:2.0:1776187968.377582:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.377616:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a235 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.377636:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a235 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.377645:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a235 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.377955:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.377963:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.377971:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.378073:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x201:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.378081:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.378088:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187968.378505:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4759, 176 off837168 00000004:00200000:2.0:1776187968.378563:0:5517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x201:0x0]: returning size 11776 00000004:00010000:2.0:1776187968.378577:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000007aa6988 reply state 00000000147ab513 transno 4294975132 ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.378617:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a235 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.378624:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a235 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.378630:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a235 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.379136:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.379221:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419072 00000100:00100000:1.0:1776187968.379261:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15418 00000100:00100000:1.0:1776187968.379266:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005a275ea2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11414:x1862467653419072:12345-192.168.204.20@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1776187968.379398:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005a275ea2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11414:x1862467653419072:12345-192.168.204.20@tcp:503:chlg_load_threa.0 Request processed in 130us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.379406:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15418 00010000:00010000:2.0:1776187968.380996:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006dbc9deb already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.381010:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a235 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.381025:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a235 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.381044:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:2.0:1776187968.381047:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.381053:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a235 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.381060:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a235 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187968.381075:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000007aa6988 reply state 00000000147ab513 transno 4294975132 ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.381183:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000007aa6988 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11406:x1862467653419008:12345-192.168.204.20@tcp:36:rm.0 Request processed in 3740us (3896us total) trans 4294975132 rc 0/0 00000100:00100000:2.0:1776187968.381196:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15417 00000100:00100000:3.0:1776187968.382178:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.388227:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187968.388269:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388283:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388291:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388297:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001be7b27e already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.388308:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388315:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388331:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x9e0a5f7e (0000000021698773) 00010000:00010000:2.0:1776187968.388334:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.388337:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388343:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a23c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x9e0a5f7e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388361:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388366:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388372:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388377:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfd2bd90 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.388378:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388383:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388388:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x201:0x0].0x0 (000000001efc7c4f) 00010000:00010000:2.0:1776187968.388390:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187968.388391:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.388396:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a243 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x201:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.391024:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419136 00000100:00100000:1.0:1776187968.391083:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419200 00000100:00100000:1.0:1776187968.391389:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15419 00000100:00100000:1.0:1776187968.391397:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e6dfd99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11414:x1862467653419136:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.392661:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e6dfd99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11414:x1862467653419136:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 1252us (10485us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.392674:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15419 00000100:00100000:1.0:1776187968.392705:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15420 00000100:00100000:1.0:1776187968.392711:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000745b1f8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+416:11406:x1862467653419200:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:1.0:1776187968.392730:0:5517:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187968.392751:0:5517:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a24a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac2a expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.392804:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a251 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x271:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.392828:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.392838:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1776187968.392904:0:5517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x271:0x0]: returning size 11776 00000004:00200000:1.0:1776187968.392908:0:5517:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1776187968.392929:0:5517:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.392953:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a24a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac2a expref: 418 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.392967:0:5517:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x271:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac2a expref: 417 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.392976:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x0 (00000000e2a29158) 00010000:00010000:1.0:1776187968.392978:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1776187968.392981:0:5517:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c48750ea, rc 0) 00000100:00100000:1.0:1776187968.393010:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000745b1f8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11406:x1862467653419200:12345-192.168.204.20@tcp:101:rm.0 Request processed in 300us (4793us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.393017:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15420 00000100:00100000:3.0:1776187968.400243:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.401525:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.401646:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419328 00000100:00100000:0.0:1776187968.401718:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4516 00000100:00100000:0.0:1776187968.401725:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e919cbcc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11406:x1862467653419328:12345-192.168.204.20@tcp:37:rm.0 00000100:00100000:1.0:1776187968.410027:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419264 00000100:00100000:1.0:1776187968.410095:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15421 00000100:00100000:1.0:1776187968.410101:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000821c619e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11414:x1862467653419264:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187968.410996:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e919cbcc pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11406:x1862467653419328:12345-192.168.204.20@tcp:37:rm.0 Request processed in 9267us (9474us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.411008:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4516 00000100:00100000:1.0:1776187968.411120:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000821c619e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11414:x1862467653419264:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 1017us (10887us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.411128:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15421 00000100:00100000:2.0:1776187968.444558:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.444609:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.450639:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419520 00000100:00100000:1.0:1776187968.450715:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15422 00000100:00100000:1.0:1776187968.450722:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e0f0926 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11414:x1862467653419520:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.451498:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e0f0926 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11414:x1862467653419520:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 773us (6887us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.451509:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15422 00000100:00100000:0.0:1776187968.452634:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419456 00000100:00100000:0.0:1776187968.452680:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4517 00000100:00100000:0.0:1776187968.452686:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e0ebc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11406:x1862467653419456:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:0.0:1776187968.453681:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e0ebc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11406:x1862467653419456:12345-192.168.204.20@tcp:35:rm.0 Request processed in 990us (9129us total) trans 4294975133 rc 0/0 00000100:00100000:0.0:1776187968.453693:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4517 00000100:00100000:1.0:1776187968.458266:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.458309:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419584 00000100:00100000:1.0:1776187968.458363:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15423 00000100:00100000:1.0:1776187968.458371:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014f0d83d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11414:x1862467653419584:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.458604:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014f0d83d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11414:x1862467653419584:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 232us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.458614:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15423 00000100:00100000:0.0:1776187968.463691:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.463789:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419712 00000100:00100000:2.0:1776187968.463860:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15424 00000100:00100000:2.0:1776187968.463868:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000330d0ea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+418:11406:x1862467653419712:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187968.463949:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187968.463975:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a251 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x271:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac2a expref: 418 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464000:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000819d8541/0x92b1eb87ee429016 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x271:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c592d expref: 417 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464015:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007fc5a1e0/0x92b1eb87ee420853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x271:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b91 expref: 416 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464027:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f71266e9/0x92b1eb87ee420781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x271:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b44 expref: 415 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464038:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x0 (00000000e2a29158) 00010000:00010000:2.0:1776187968.464048:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.464084:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a258 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464112:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a258 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464121:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a258 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464135:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464141:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464147:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464329:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x271:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464342:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x271:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.464347:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x271:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187968.465069:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4760, 176 off837344 00000004:00200000:2.0:1776187968.465148:0:5517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x271:0x0]: returning size 11776 00000004:00010000:2.0:1776187968.465174:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000330d0ea8 reply state 00000000ed9fc471 transno 4294975134 ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x271:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.465212:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a258 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.465219:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a258 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.465225:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a258 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.465230:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfd2bd90 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.465234:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a258 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.465277:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a258 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.465287:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:2.0:1776187968.465290:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.465294:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a258 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.465299:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a258 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187968.465307:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000330d0ea8 reply state 00000000ed9fc471 transno 4294975134 ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.465398:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000330d0ea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+416:11406:x1862467653419712:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1528us (1713us total) trans 4294975134 rc 0/0 00000100:00100000:2.0:1776187968.465407:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15424 00000100:00100000:1.0:1776187968.471743:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.472531:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419776 00000100:00100000:2.0:1776187968.472587:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15425 00000100:00100000:2.0:1776187968.472593:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000230b7dd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+416:11414:x1862467653419776:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.472796:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000230b7dd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+416:11414:x1862467653419776:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 201us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.472805:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15425 00010000:00010000:3.0:1776187968.474780:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.474796:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.474988:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.474997:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001be7b27e already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.475001:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.475008:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.475023:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x2c71d537 (0000000021698773) 00010000:00010000:3.0:1776187968.475025:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.475029:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.475033:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001be7b27e/0x92b1eb87ee43a25f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f6:0x0].0x2c71d537 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.475049:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x271:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.475054:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x271:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.475058:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x271:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.475064:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006dbc9deb already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.475065:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x271:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.475070:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x271:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.475077:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x271:0x0].0x0 (00000000780f5f5c) 00010000:00010000:3.0:1776187968.475079:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187968.475081:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x271:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.475086:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000006dbc9deb/0x92b1eb87ee43a266 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x271:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.475232:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.475294:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.475322:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419968 00000100:00100000:1.0:1776187968.475360:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15426 00000100:00100000:1.0:1776187968.475366:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6cedb7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+415:11414:x1862467653419968:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.475562:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6cedb7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+415:11414:x1862467653419968:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 194us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.475570:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15426 00000100:00100000:0.0:1776187968.476797:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653419904 00000100:00100000:0.0:1776187968.476840:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4518 00000100:00100000:0.0:1776187968.476848:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005467921f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+415:11406:x1862467653419904:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:0.0:1776187968.477232:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005467921f pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+416:11406:x1862467653419904:12345-192.168.204.20@tcp:35:rm.0 Request processed in 383us (2001us total) trans 4294975135 rc 0/0 00000100:00100000:0.0:1776187968.477244:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4518 00000100:00100000:1.0:1776187968.481253:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.481326:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.481366:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420032 00000100:00100000:1.0:1776187968.481413:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420160 00000100:00100000:1.0:1776187968.481438:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15427 00000100:00100000:1.0:1776187968.481444:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008873d140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11414:x1862467653420032:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.481802:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008873d140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+417:11414:x1862467653420032:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 355us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.481811:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15427 00000100:00100000:1.0:1776187968.481830:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15428 00000100:00100000:1.0:1776187968.481835:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000873e8b1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+416:11406:x1862467653420160:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:1.0:1776187968.481901:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1776187968.481931:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000054be524b/0x92b1eb87ee41e4b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d2f expref: 416 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.481955:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001c638a77/0x92b1eb87ee4212f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2f42 expref: 415 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.481973:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000008d3f03a0/0x92b1eb87ee41d9fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1900 expref: 414 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.481985:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000abcb224f) 00010000:00010000:1.0:1776187968.482005:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000597b6781/0x92b1eb87ee439fc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cabac expref: 413 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.482016:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (00000000b347ce5e) 00010000:00010000:1.0:1776187968.482021:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.482052:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a26d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.482066:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a26d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.482077:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a26d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.482275:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.482285:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.482293:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.482395:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.482405:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.482412:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187968.483044:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4761, 176 off837520 00000004:00200000:1.0:1776187968.483191:0:6573:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f6:0x0]: returning size 11776 00000004:00010000:1.0:1776187968.483207:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000873e8b1c reply state 000000008916cd5d transno 4294975136 ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.483253:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a26d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.483259:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a26d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.483265:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a26d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.483271:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.483275:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a26d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.483282:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a26d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.483293:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (00000000b347ce5e) 00010000:00010000:1.0:1776187968.483296:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187968.483299:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a26d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.483305:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a26d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187968.483313:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000873e8b1c reply state 000000008916cd5d transno 4294975136 ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.484361:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000873e8b1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+414:11406:x1862467653420160:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2522us (3031us total) trans 4294975136 rc 0/0 00000100:00100000:1.0:1776187968.484377:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15428 00000100:00100000:0.0:1776187968.485901:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.487723:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420224 00000100:00100000:0.0:1776187968.487977:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15429 00000100:00100000:0.0:1776187968.487985:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e04bcb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+414:11414:x1862467653420224:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00010000:00010000:2.0:1776187968.489304:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489321:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489327:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489333:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.489337:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489344:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489359:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0xfe8990f0 (00000000889219c6) 00010000:00010000:2.0:1776187968.489362:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.489365:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489371:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a274 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f4:0x0].0xfe8990f0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489390:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489396:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489400:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489405:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.489407:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489412:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489419:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f6:0x0].0x0 (00000000a45e680a) 00010000:00010000:2.0:1776187968.489421:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187968.489423:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.489427:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a27b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.490848:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e04bcb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+413:11414:x1862467653420224:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 2852us (4965us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.490864:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15429 00000100:00100000:1.0:1776187968.491450:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.493814:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420352 00000100:00100000:2.0:1776187968.493903:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4519 00000100:00100000:2.0:1776187968.493910:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093f1ba7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+414:11406:x1862467653420352:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187968.494558:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093f1ba7d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+414:11406:x1862467653420352:12345-192.168.204.20@tcp:35:rm.0 Request processed in 645us (3109us total) trans 4294975137 rc 0/0 00000100:00100000:2.0:1776187968.494568:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4519 00000100:00100000:1.0:1776187968.499997:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.500074:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420416 00000100:00100000:3.0:1776187968.500133:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15430 00000100:00100000:3.0:1776187968.500140:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000305ca8f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+414:11414:x1862467653420416:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187968.503041:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000305ca8f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+414:11414:x1862467653420416:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 2889us (3041us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.503061:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15430 00000100:00100000:1.0:1776187968.504065:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.504868:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420544 00000100:00100000:3.0:1776187968.504949:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15431 00000100:00100000:3.0:1776187968.504956:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000036845b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+414:11406:x1862467653420544:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:3.0:1776187968.505021:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1776187968.505047:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000a9d377dd/0x92b1eb87ee42119f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ed9 expref: 414 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505069:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d20b8837/0x92b1eb87ee41d57e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1724 expref: 413 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505081:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000c8d7e945/0x92b1eb87ee41d4b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c16f3 expref: 412 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505090:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (00000000b347ce5e) 00010000:00010000:3.0:1776187968.505099:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187968.505131:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a282 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505146:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a282 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505156:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a282 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505182:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505189:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505195:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505308:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505317:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.505328:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1776187968.505910:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4762, 176 off837696 00000004:00200000:3.0:1776187968.505979:0:12471:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f4:0x0]: returning size 11776 00000004:00010000:3.0:1776187968.505994:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000036845b2 reply state 000000007ebb5dc0 transno 4294975138 ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.506036:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a282 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.506044:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a282 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.506051:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a282 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.506057:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007dfea8c8 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.506062:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a282 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.506071:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a282 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.506083:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (000000003d48dd25) 00010000:00010000:3.0:1776187968.506086:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.506090:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a282 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.506101:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a282 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1f1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187968.506111:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000036845b2 reply state 000000007ebb5dc0 transno 4294975138 ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.506223:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000036845b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+413:11406:x1862467653420544:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1266us (2161us total) trans 4294975138 rc 0/0 00000100:00100000:3.0:1776187968.506232:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15431 00000001:00080000:0.0:1776187968.510861:0:5537:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 4294975130 is committed 00000004:00080000:0.0:1776187968.510916:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 102 committed 00000004:00080000:0.0:1776187968.511059:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 101 committed 00000001:00080000:0.0:1776187968.511124:0:5537:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 4294975131 is committed 00000004:00080000:0.0:1776187968.511192:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 103 committed 00000004:00080000:0.0:1776187968.511265:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 101 committed 00000004:00080000:0.0:1776187968.511331:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 100 committed 00000004:00080000:0.0:1776187968.511383:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 100 committed 00000001:00080000:0.0:1776187968.511393:0:5537:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 4294975132 is committed 00000004:00080000:0.0:1776187968.511535:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 102 committed 00000004:00080000:0.0:1776187968.511615:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 99 committed 00000100:00100000:0.0:1776187968.512059:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000060f785d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659897344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.512138:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.512184:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012c0d89e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659897600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1776187968.512191:0:10783:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897344 00000100:00100000:0.0:1776187968.512208:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.512227:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eb462d1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659897856:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187968.512247:0:10783:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897600 00000100:00100000:0.0:1776187968.512253:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.512694:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f9699837 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659898112:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.512722:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187968.513021:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000812af665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659897536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1776187968.513053:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c01fecec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659897472:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1776187968.513077:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000346ea37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659897408:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1776187968.516477:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1776187968.516530:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516545:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516552:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516558:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030c08888 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.516562:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516569:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516584:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x977fac0d (0000000037029ea1) 00010000:00010000:1.0:1776187968.516588:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187968.516591:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516597:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000030c08888/0x92b1eb87ee43a289 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f1:0x0].0x977fac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516615:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516626:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516631:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516635:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000547596a2 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.516637:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516642:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516649:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f4:0x0].0x0 (000000003846d7f8) 00010000:00010000:1.0:1776187968.516651:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187968.516653:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.516658:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a290 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.516697:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420608 00000100:00100000:1.0:1776187968.516775:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15432 00000100:00100000:1.0:1776187968.516782:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aeb0ddc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+41:11414:x1862467653420608:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.517286:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aeb0ddc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+41:11414:x1862467653420608:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 503us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.517294:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15432 00000100:00100000:2.0:1776187968.522894:0:10783:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897856 00000100:00100000:1.0:1776187968.522897:0:11792:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659898112 00000100:00100000:2.0:1776187968.522971:0:10783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2787 00000100:00100000:2.0:1776187968.522977:0:10783:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006439688d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:2993:x1862467659897344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1776187968.523011:0:10783:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:423 count 1 00010000:00010000:2.0:1776187968.523038:0:10783:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 3/0,1 mode: --/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.523047:0:11797:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2788 00000100:00100000:0.0:1776187968.523054:0:11797:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a10603c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:2993:x1862467659897600:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1776187968.523062:0:10783:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000129b7547/0x92b1eb87ee437f9e lrc: 2/0,0 mode: PR/PR res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca562 expref: 70 pid: 11824 timeout: 0 lvb_type: 1 00002000:00080000:0.0:1776187968.523069:0:11797:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:232 count 1 00010000:00010000:2.0:1776187968.523072:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.523075:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.523077:0:10783:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 4/0,1 mode: --/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.523084:0:11797:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 3/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.523098:0:11797:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000027716d25/0x92b1eb87ee41d65e lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1778 expref: 70 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.523105:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.523106:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.523107:0:11797:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 4/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.523137:0:11797:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000027716d25/0x92b1eb87ee41d65e lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1778 expref: 70 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.523148:0:11797:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000027716d25/0x92b1eb87ee41d65e lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1778 expref: 70 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.523159:0:11797:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089eb1245 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:11797:1862467659898368:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.523238:0:11797:0:(client.c:2500:ptlrpc_set_wait()) set 000000001b578632 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.523264:0:11824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2789 00000100:00100000:0.0:1776187968.523268:0:11824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f42d7af2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:2993:x1862467659897856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.523283:0:11824:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:419 count 1 00010000:00010000:0.0:1776187968.523297:0:11824:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 3/0,1 mode: --/PW res: [0x1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.523388:0:11824:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e52a3f56/0x92b1eb87ee4372af lrc: 2/0,0 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca12c expref: 89 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.523394:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.523395:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.523396:0:11824:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 4/0,1 mode: --/PW res: [0x1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.523413:0:11824:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e52a3f56/0x92b1eb87ee4372af lrc: 3/0,0 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca12c expref: 89 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.523420:0:11824:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e52a3f56/0x92b1eb87ee4372af lrc: 4/0,0 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca12c expref: 89 pid: 10783 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.523429:0:11824:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d41c77b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:11824:1862467659898432:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.523451:0:11824:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e141f268 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.523475:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.523510:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031f2b725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659897728:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.523541:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.523554:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b768e705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659897984:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.523570:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.523583:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed0ab337 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659898240:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.523596:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.523624:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.523651:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008b1fba72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659897792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.523671:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.523682:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f16eb28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659898048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.523697:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.523708:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053e106e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659898304:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.523725:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.523752:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897472 00000100:00100000:0.0:1776187968.523774:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897728 00000100:00100000:0.0:1776187968.523787:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897984 00000100:00100000:0.0:1776187968.523800:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659898240 00000100:00100000:0.0:1776187968.523812:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897536 00000100:00100000:0.0:1776187968.523823:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897792 00000100:00100000:0.0:1776187968.523831:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659898048 00000100:00100000:0.0:1776187968.523838:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659898304 00000100:00100000:0.0:1776187968.523848:0:11825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2790 00000100:00100000:0.0:1776187968.523851:0:11825:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000894dc1df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+10:2995:x1862467659897472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.523862:0:11825:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:426 count 1 00010000:00010000:0.0:1776187968.523891:0:11825:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 3/0,1 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.523902:0:11825:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c64851a8/0x92b1eb87ee4388b2 lrc: 2/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca864 expref: 70 pid: 11797 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1776187968.523908:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.523910:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.523911:0:11825:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 4/0,1 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524117:0:11825:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c64851a8/0x92b1eb87ee4388b2 lrc: 3/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca864 expref: 70 pid: 11797 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1776187968.524133:0:11825:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c64851a8/0x92b1eb87ee4388b2 lrc: 4/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca864 expref: 70 pid: 11797 timeout: 545 lvb_type: 1 00000100:00100000:0.0:1776187968.524143:0:11825:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007eb3c018 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:11825:1862467659898496:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.524180:0:11825:0:(client.c:2500:ptlrpc_set_wait()) set 0000000049204588 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.524198:0:11819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2791 00000100:00100000:0.0:1776187968.524203:0:11819:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052710b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+10:2995:x1862467659897728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.524217:0:11819:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:284 count 1 00010000:00010000:0.0:1776187968.524227:0:11819:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 3/0,1 mode: --/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524237:0:11819:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5de679f/0x92b1eb87ee420670 lrc: 2/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ae2 expref: 70 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524244:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.524245:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.524246:0:11819:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 4/0,1 mode: --/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524262:0:11819:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d5de679f/0x92b1eb87ee420670 lrc: 3/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ae2 expref: 70 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524269:0:11819:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d5de679f/0x92b1eb87ee420670 lrc: 4/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ae2 expref: 70 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.524277:0:11819:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2203b2c pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:11819:1862467659898560:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.524298:0:11819:0:(client.c:2500:ptlrpc_set_wait()) set 0000000004e79992 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.524402:0:11795:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2792 00000100:00100000:0.0:1776187968.524406:0:11795:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000843473e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:2995:x1862467659897984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.524419:0:11795:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:421 count 1 00010000:00010000:0.0:1776187968.524431:0:11795:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 3/0,1 mode: --/PW res: [0x1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524442:0:11795:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee437771 lrc: 2/0,0 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca2b4 expref: 89 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524447:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.524448:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.524450:0:11795:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 4/0,1 mode: --/PW res: [0x1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524467:0:11795:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee437771 lrc: 3/0,0 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca2b4 expref: 89 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524474:0:11795:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee437771 lrc: 4/0,0 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca2b4 expref: 89 pid: 11792 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.524483:0:11795:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000025fccc35 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:11795:1862467659898624:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.524507:0:11795:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d630d36f going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.524526:0:11829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2793 00000100:00100000:0.0:1776187968.524530:0:11829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d1f0f2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+10:2995:x1862467659898240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.524540:0:11829:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:237 count 1 00010000:00010000:0.0:1776187968.524550:0:11829:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 3/0,1 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524560:0:11829:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000008898d9/0x92b1eb87ee41d98a lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18dd expref: 89 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524566:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.524567:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.524568:0:11829:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 4/0,1 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524583:0:11829:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000008898d9/0x92b1eb87ee41d98a lrc: 3/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18dd expref: 89 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524590:0:11829:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000008898d9/0x92b1eb87ee41d98a lrc: 4/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18dd expref: 89 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.524597:0:11829:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e127d529 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:11829:1862467659898688:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.524617:0:11829:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bcc2b55 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.524714:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2794 00000100:00100000:0.0:1776187968.524718:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006afce0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:2996:x1862467659897536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.524730:0:11816:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:234 count 1 00010000:00010000:0.0:1776187968.524742:0:11816:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 3/0,1 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524751:0:11816:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000094ea8a6e/0x92b1eb87ee41d7e6 lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1820 expref: 70 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524757:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.524758:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.524760:0:11816:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 4/0,1 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524778:0:11816:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000094ea8a6e/0x92b1eb87ee41d7e6 lrc: 3/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1820 expref: 70 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524785:0:11816:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000094ea8a6e/0x92b1eb87ee41d7e6 lrc: 4/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1820 expref: 70 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.524792:0:11816:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b84092ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:11816:1862467659898752:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.524812:0:11816:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e8587547 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.524827:0:6329:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2795 00000100:00100000:0.0:1776187968.524831:0:6329:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000046010e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:2996:x1862467659897792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.524843:0:6329:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:246 count 1 00010000:00010000:0.0:1776187968.524852:0:6329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 3/0,1 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524862:0:6329:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002290ff93/0x92b1eb87ee41e488 lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d13 expref: 70 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524867:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.524869:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.524870:0:6329:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 4/0,1 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524909:0:6329:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002290ff93/0x92b1eb87ee41e488 lrc: 3/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d13 expref: 70 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.524922:0:6329:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002290ff93/0x92b1eb87ee41e488 lrc: 4/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d13 expref: 70 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.525206:0:6329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d81b363c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6329:1862467659898816:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.525231:0:6329:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e63b39b0 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.525248:0:11790:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2796 00000100:00100000:0.0:1776187968.525253:0:11790:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077c3b583 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:2996:x1862467659898048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.525266:0:11790:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:425 count 1 00010000:00010000:0.0:1776187968.525277:0:11790:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 3/0,1 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.525287:0:11790:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccad8d39/0x92b1eb87ee43848a lrc: 2/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6ff expref: 89 pid: 6326 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1776187968.525293:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.525294:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.525296:0:11790:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 4/0,1 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.525402:0:11790:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccad8d39/0x92b1eb87ee43848a lrc: 3/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6ff expref: 89 pid: 6326 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1776187968.525410:0:11790:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccad8d39/0x92b1eb87ee43848a lrc: 4/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6ff expref: 89 pid: 6326 timeout: 545 lvb_type: 1 00000100:00100000:0.0:1776187968.525418:0:11790:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000402a2b37 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659898880:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.525435:0:11790:0:(client.c:2500:ptlrpc_set_wait()) set 000000000638ad3a going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.525452:0:11826:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2797 00000100:00100000:0.0:1776187968.525457:0:11826:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd946725 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+10:2996:x1862467659898304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.525470:0:11826:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:236 count 1 00010000:00010000:0.0:1776187968.525480:0:11826:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 3/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.525490:0:11826:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078973247/0x92b1eb87ee41d8c6 lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1889 expref: 89 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.525495:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.525496:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.525498:0:11826:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 4/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.525514:0:11826:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078973247/0x92b1eb87ee41d8c6 lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1889 expref: 89 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.525522:0:11826:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078973247/0x92b1eb87ee41d8c6 lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1889 expref: 89 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.525530:0:11826:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7d6744b pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:11826:1862467659898944:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.525548:0:11826:0:(client.c:2500:ptlrpc_set_wait()) set 000000009e29dcf9 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.525584:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.525621:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024f833d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659897664:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.525751:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.525768:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c493e10a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659897920:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.525787:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.525798:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008dcb65fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659898176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.525814:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.525848:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897408 00000100:00100000:0.0:1776187968.525871:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897664 00000100:00100000:0.0:1776187968.525904:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659897920 00000100:00100000:0.0:1776187968.525911:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659898176 00000100:00100000:0.0:1776187968.525919:0:9338:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2798 00000100:00100000:0.0:1776187968.525922:0:9338:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e88f43fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:2994:x1862467659897408:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.526061:0:11792:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2799 00000100:00100000:1.0:1776187968.526066:0:11792:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005cd1bbde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:2994:x1862467659897664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.526079:0:11792:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:242 count 1 00010000:00010000:1.0:1776187968.526092:0:11792:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 3/0,1 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.526104:0:11792:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000edaaa4a3/0x92b1eb87ee41e14e lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bc3 expref: 70 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.526110:0:11792:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.526111:0:11792:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.526113:0:11792:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 4/0,1 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.526130:0:11792:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000edaaa4a3/0x92b1eb87ee41e14e lrc: 3/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bc3 expref: 70 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.526137:0:11792:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000edaaa4a3/0x92b1eb87ee41e14e lrc: 4/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bc3 expref: 70 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.526147:0:11792:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f965700f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:11792:1862467659899008:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.526177:0:11792:0:(client.c:2500:ptlrpc_set_wait()) set 000000009e2d7a44 going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.526195:0:11794:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2800 00000100:00100000:1.0:1776187968.526199:0:11794:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb31ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:2994:x1862467659897920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.526210:0:11794:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:420 count 1 00010000:00010000:1.0:1776187968.526221:0:11794:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 3/0,1 mode: --/PW res: [0x1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.526236:0:11794:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000787e291/0x92b1eb87ee437587 lrc: 2/0,0 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca21a expref: 89 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.526241:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.526242:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.526243:0:11794:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 4/0,1 mode: --/PW res: [0x1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.526259:0:11794:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000787e291/0x92b1eb87ee437587 lrc: 3/0,0 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca21a expref: 89 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.526266:0:11794:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000787e291/0x92b1eb87ee437587 lrc: 4/0,0 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca21a expref: 89 pid: 6326 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.526274:0:11794:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1d41ccf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:11794:1862467659899072:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.526292:0:11794:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026fd70c8 going to sleep for 43 seconds 00002000:00080000:0.0:1776187968.526397:0:9338:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:424 count 1 00010000:00010000:0.0:1776187968.526410:0:9338:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 3/0,1 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526420:0:9338:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee4383bf lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6b9 expref: 70 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526426:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.526427:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.526429:0:9338:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 4/0,1 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526444:0:9338:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee4383bf lrc: 3/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6b9 expref: 70 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526451:0:9338:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee4383bf lrc: 4/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6b9 expref: 70 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.526460:0:9338:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000088bac792 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9338:1862467659899136:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.526479:0:9338:0:(client.c:2500:ptlrpc_set_wait()) set 00000000969e28c2 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.526496:0:11796:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2801 00000100:00100000:0.0:1776187968.526500:0:11796:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ead899a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:2994:x1862467659898176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.526511:0:11796:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:426 count 1 00010000:00010000:0.0:1776187968.526520:0:11796:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 3/0,1 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526530:0:11796:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028ead050/0x92b1eb87ee4387d9 lrc: 2/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca81e expref: 89 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526536:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.526537:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.526538:0:11796:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 4/0,1 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526552:0:11796:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028ead050/0x92b1eb87ee4387d9 lrc: 3/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca81e expref: 89 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526559:0:11796:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028ead050/0x92b1eb87ee4387d9 lrc: 4/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca81e expref: 89 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.526567:0:11796:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000280e0900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:11796:1862467659899200:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.526583:0:11796:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c391d1e7 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.526597:0:11818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2802 00000100:00100000:0.0:1776187968.526602:0:11818:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3eeab83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:2993:x1862467659898112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.526615:0:11818:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:422 count 1 00010000:00010000:0.0:1776187968.526624:0:11818:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 3/0,1 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526790:0:11818:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000017234a62/0x92b1eb87ee437a96 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca3be expref: 89 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526796:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.526797:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.526799:0:11818:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 4/0,1 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526816:0:11818:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000017234a62/0x92b1eb87ee437a96 lrc: 3/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca3be expref: 89 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.526822:0:11818:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000017234a62/0x92b1eb87ee437a96 lrc: 4/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca3be expref: 89 pid: 11792 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.526831:0:11818:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000783ba691 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659899264:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.526849:0:11818:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e9a55fb9 going to sleep for 43 seconds 00000100:00100000:3.0:1776187968.527652:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187968.527656:0:10783:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000129b7547/0x92b1eb87ee437f9e lrc: 3/0,0 mode: PR/PR res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca562 expref: 70 pid: 11824 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1776187968.527668:0:10783:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000129b7547/0x92b1eb87ee437f9e lrc: 4/0,0 mode: PR/PR res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca562 expref: 70 pid: 11824 timeout: 545 lvb_type: 1 00000100:00100000:2.0:1776187968.527679:0:10783:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000416f053d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10783:1862467659899328:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.527706:0:10783:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f5011558 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.528046:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420672 00000100:00100000:0.0:1776187968.528092:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15433 00000100:00100000:0.0:1776187968.528098:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9a8472 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+41:11406:x1862467653420672:12345-192.168.204.20@tcp:101:rm.0 00010000:00010000:0.0:1776187968.528113:0:6573:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1776187968.528130:0:6573:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000033a084bb/0x92b1eb87ee43a307 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac31 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528191:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a30e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528203:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a30e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528214:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a30e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528227:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a315 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528233:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528239:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528481:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a31c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528490:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a31c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528497:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a31c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1776187968.528536:0:6573:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f1:0x0]: returning size 11776 00000004:00200000:0.0:1776187968.528539:0:6573:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1776187968.528561:0:6573:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a31c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528571:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a30e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528576:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a30e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528583:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a30e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528589:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ec1ebc7a already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187968.528592:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a30e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528598:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a30e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528609:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:0.0:1776187968.528611:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187968.528615:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a30e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528620:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a30e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528629:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a315 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528634:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a315 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528639:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528644:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000095ae11d5 already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187968.528645:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a315 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528650:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a315 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528656:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x12eaac0d (000000000f84370d) 00010000:00010000:0.0:1776187968.528658:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187968.528659:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a315 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528664:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a315 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528694:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000033a084bb/0x92b1eb87ee43a307 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac31 expref: 43 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528705:0:6573:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a31c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac31 expref: 42 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.528711:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (000000003d48dd25) 00010000:00010000:0.0:1776187968.528713:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1776187968.528715:0:6573:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cc9474fb, rc 0) 00000100:00100000:0.0:1776187968.528769:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9a8472 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:11406:x1862467653420672:12345-192.168.204.20@tcp:101:rm.0 Request processed in 670us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.528777:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15433 00000001:00080000:3.0:1776187968.532411:0:7131:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968170 is committed 00000100:00100000:2.0:1776187968.545453:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545471:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545495:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545531:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545549:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545575:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545615:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545630:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545699:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545712:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545726:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545740:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545753:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.545800:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420864 00000100:00100000:2.0:1776187968.545808:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545820:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.545836:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187968.545850:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c64851a8/0x92b1eb87ee4388b2 lrc: 5/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca864 expref: 71 pid: 11797 timeout: 545 lvb_type: 1 00000100:00100000:2.0:1776187968.545911:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.545919:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420736 00000100:00100000:2.0:1776187968.545929:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420800 00010000:00010000:0.0:1776187968.545932:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e52a3f56/0x92b1eb87ee4372af lrc: 5/0,0 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca12c expref: 75 pid: 10783 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.545941:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000027716d25/0x92b1eb87ee41d65e lrc: 5/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1778 expref: 72 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.545944:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420992 00000100:00100000:2.0:1776187968.545954:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653420928 00010000:00010000:2.0:1776187968.545962:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d5de679f/0x92b1eb87ee420670 lrc: 5/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ae2 expref: 73 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.545962:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee437771 lrc: 5/0,0 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca2b4 expref: 76 pid: 11792 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.545974:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421184 00000100:00100000:0.0:1776187968.545974:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421120 00010000:00010000:2.0:1776187968.545982:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000094ea8a6e/0x92b1eb87ee41d7e6 lrc: 5/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1820 expref: 74 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.545982:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000008898d9/0x92b1eb87ee41d98a lrc: 5/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18dd expref: 77 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.545992:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421248 00000100:00100000:0.0:1776187968.545992:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421376 00010000:00010000:0.0:1776187968.545998:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078973247/0x92b1eb87ee41d8c6 lrc: 5/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1889 expref: 78 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.545999:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002290ff93/0x92b1eb87ee41e488 lrc: 5/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d13 expref: 75 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.546008:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421504 00000100:00100000:2.0:1776187968.546009:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421312 00010000:00010000:2.0:1776187968.546015:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccad8d39/0x92b1eb87ee43848a lrc: 5/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6ff expref: 80 pid: 6326 timeout: 545 lvb_type: 1 00010000:00010000:0.0:1776187968.546015:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000787e291/0x92b1eb87ee437587 lrc: 5/0,0 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca21a expref: 80 pid: 6326 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.546025:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421568 00000100:00100000:0.0:1776187968.546025:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421440 00010000:00010000:2.0:1776187968.546031:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee4383bf lrc: 5/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6b9 expref: 77 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.546032:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000edaaa4a3/0x92b1eb87ee41e14e lrc: 5/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bc3 expref: 77 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.546042:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421824 00000100:00100000:0.0:1776187968.546042:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421696 00010000:00010000:2.0:1776187968.546048:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000129b7547/0x92b1eb87ee437f9e lrc: 5/0,0 mode: PR/PR res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca562 expref: 78 pid: 11824 timeout: 545 lvb_type: 1 00010000:00010000:0.0:1776187968.546048:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028ead050/0x92b1eb87ee4387d9 lrc: 5/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca81e expref: 81 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.546062:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4317 00000100:00100000:2.0:1776187968.546277:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ba2a942 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+78:2222:x1862467653420864:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1776187968.546300:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.546305:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c64851a8/0x92b1eb87ee4388b2 lrc: 5/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca864 expref: 78 pid: 11797 timeout: 545 lvb_type: 1 00010000:00010000:2.0:1776187968.546316:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c64851a8/0x92b1eb87ee4388b2 lrc: 4/0,0 mode: PR/PR res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca864 expref: 78 pid: 11797 timeout: 545 lvb_type: 1 00010000:00010000:2.0:1776187968.546345:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.546347:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.546350:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 3/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.546359:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 4/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.546384:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.546434:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ba2a942 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+78:2222:x1862467653420864:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 365us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.548237:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4318 00000100:00100000:0.0:1776187968.548256:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008599647e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+81:2225:x1862467653420736:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1776187968.548267:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4319 00000100:00100000:1.0:1776187968.548275:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ab480bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+78:2225:x1862467653420800:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1776187968.548292:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.548294:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.548307:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e52a3f56/0x92b1eb87ee4372af lrc: 5/0,0 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca12c expref: 81 pid: 10783 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.548324:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e52a3f56/0x92b1eb87ee4372af lrc: 4/0,0 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca12c expref: 81 pid: 10783 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.548581:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000027716d25/0x92b1eb87ee41d65e lrc: 5/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1778 expref: 78 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.548597:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000027716d25/0x92b1eb87ee41d65e lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1778 expref: 78 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.548613:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.548615:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.548616:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.548618:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.548621:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 3/0,1 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.548622:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.548635:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 4/0,1 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.548658:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.548727:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 4/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.548742:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.548786:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ab480bd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+78:2225:x1862467653420800:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 511us (3290us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.548794:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4319 00000100:00100000:1.0:1776187968.548827:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4320 00000100:00100000:1.0:1776187968.548832:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050e0db89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+81:2224:x1862467653420992:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1776187968.548838:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008599647e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+81:2225:x1862467653420736:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 582us (3363us total) trans 0 rc 0/0 00010000:00010000:1.0:1776187968.548842:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.548849:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee437771 lrc: 5/0,0 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca2b4 expref: 81 pid: 11792 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.548850:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4318 00010000:00010000:1.0:1776187968.548860:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee437771 lrc: 4/0,0 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca2b4 expref: 81 pid: 11792 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.548893:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.548895:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1776187968.548896:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4321 00010000:00010000:1.0:1776187968.548898:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 3/0,1 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.548907:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d74ae161 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+77:2224:x1862467653420928:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1776187968.548909:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 4/0,1 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.548919:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.548923:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.548927:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d5de679f/0x92b1eb87ee420670 lrc: 5/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ae2 expref: 77 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.548937:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d5de679f/0x92b1eb87ee420670 lrc: 4/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ae2 expref: 77 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.549054:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.549056:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.549058:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 3/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.549065:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 4/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.549078:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.549080:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050e0db89 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+80:2224:x1862467653420992:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 246us (3548us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.549089:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4320 00000100:00100000:0.0:1776187968.549101:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d74ae161 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+77:2224:x1862467653420928:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 196us (3551us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.549107:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4322 00000100:00100000:1.0:1776187968.549113:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008fd1dad5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+77:2223:x1862467653421184:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00000100:00100000:0.0:1776187968.549118:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4321 00010000:00010000:1.0:1776187968.549122:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.549128:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000094ea8a6e/0x92b1eb87ee41d7e6 lrc: 5/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1820 expref: 76 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.549138:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4323 00010000:00010000:1.0:1776187968.549139:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000094ea8a6e/0x92b1eb87ee41d7e6 lrc: 4/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1820 expref: 76 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.549147:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a4e5517 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+79:2223:x1862467653421120:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1776187968.549158:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.549170:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.549172:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.549174:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000008898d9/0x92b1eb87ee41d98a lrc: 5/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18dd expref: 79 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.549175:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.549193:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 4/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.549196:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000008898d9/0x92b1eb87ee41d98a lrc: 4/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18dd expref: 79 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.549217:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.549220:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.549223:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.549225:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.549232:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 4/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.549239:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008fd1dad5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+76:2223:x1862467653421184:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 122us (3605us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.549250:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4322 00010000:00010000:0.0:1776187968.549256:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.549266:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4324 00000100:00100000:1.0:1776187968.549272:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000bf0cc0f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+79:2223:x1862467653421376:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1776187968.549281:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.549286:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078973247/0x92b1eb87ee41d8c6 lrc: 5/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1889 expref: 79 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.549292:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a4e5517 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+79:2223:x1862467653421120:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 144us (3673us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.549303:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4323 00000100:00100000:0.0:1776187968.549317:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4325 00000100:00100000:0.0:1776187968.549321:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028e219af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+75:2223:x1862467653421248:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1776187968.549340:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.549345:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002290ff93/0x92b1eb87ee41e488 lrc: 5/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d13 expref: 75 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.549354:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002290ff93/0x92b1eb87ee41e488 lrc: 4/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d13 expref: 75 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.549367:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.549368:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.549370:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.549375:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 4/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.549386:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.549402:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028e219af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+75:2223:x1862467653421248:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 80us (3704us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.549409:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4325 00000100:00100000:0.0:1776187968.549424:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4326 00000100:00100000:0.0:1776187968.549429:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a48933a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+78:2223:x1862467653421504:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1776187968.549450:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078973247/0x92b1eb87ee41d8c6 lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1889 expref: 78 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.549464:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.549466:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.549468:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.549473:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 4/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.549483:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.549498:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000bf0cc0f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+78:2223:x1862467653421376:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 226us (3786us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.549505:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4324 00000100:00100000:1.0:1776187968.549519:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4327 00000100:00100000:1.0:1776187968.549524:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000183af6c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+77:2223:x1862467653421312:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1776187968.549532:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.549535:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccad8d39/0x92b1eb87ee43848a lrc: 5/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6ff expref: 77 pid: 6326 timeout: 545 lvb_type: 1 00010000:00010000:1.0:1776187968.549544:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccad8d39/0x92b1eb87ee43848a lrc: 4/0,0 mode: PR/PR res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6ff expref: 77 pid: 6326 timeout: 545 lvb_type: 1 00010000:00010000:1.0:1776187968.549556:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.549558:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.549559:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.549565:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 4/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.549575:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.549587:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000183af6c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+77:2223:x1862467653421312:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 62us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.549594:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4327 00000100:00100000:1.0:1776187968.549606:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4328 00000100:00100000:1.0:1776187968.549610:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068f8989e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+74:2223:x1862467653421440:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1776187968.549617:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.549621:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000edaaa4a3/0x92b1eb87ee41e14e lrc: 5/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bc3 expref: 74 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.549824:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000edaaa4a3/0x92b1eb87ee41e14e lrc: 4/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bc3 expref: 74 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.549839:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.549840:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.549842:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.549848:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 4/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.549860:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.549906:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068f8989e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+74:2223:x1862467653421440:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 295us (4152us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.549913:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4328 00000100:00100000:1.0:1776187968.549927:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4329 00000100:00100000:1.0:1776187968.549941:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f1d31b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+73:2223:x1862467653421568:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1776187968.549949:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.549953:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee4383bf lrc: 5/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6b9 expref: 73 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.549963:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee4383bf lrc: 4/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6b9 expref: 73 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.550063:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.550068:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000787e291/0x92b1eb87ee437587 lrc: 5/0,0 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca21a expref: 76 pid: 6326 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.550078:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000787e291/0x92b1eb87ee437587 lrc: 4/0,0 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca21a expref: 76 pid: 6326 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.550093:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.550094:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.550096:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 3/0,1 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550103:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 4/0,1 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550114:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.550130:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a48933a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+76:2223:x1862467653421504:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 700us (4403us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.550137:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4326 00000100:00100000:0.0:1776187968.550185:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4330 00000100:00100000:0.0:1776187968.550190:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d65b5018 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+75:2224:x1862467653421696:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.550197:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.550201:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028ead050/0x92b1eb87ee4387d9 lrc: 5/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca81e expref: 75 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.550210:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028ead050/0x92b1eb87ee4387d9 lrc: 4/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca81e expref: 75 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.550222:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.550223:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.550225:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 3/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550232:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 4/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550241:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.550252:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d65b5018 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+75:2224:x1862467653421696:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 61us (4342us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.550257:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4330 00000100:00100000:0.0:1776187968.550268:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4331 00000100:00100000:0.0:1776187968.550271:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a3502aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+73:2223:x1862467653421824:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1776187968.550286:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.550290:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000129b7547/0x92b1eb87ee437f9e lrc: 5/0,0 mode: PR/PR res: [0x1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca562 expref: 73 pid: 11824 timeout: 545 lvb_type: 1 00010000:00010000:0.0:1776187968.550297:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000129b7547/0x92b1eb87ee437f9e lrc: 4/0,0 mode: PR/PR res: [0x1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca562 expref: 73 pid: 11824 timeout: 545 lvb_type: 1 00010000:00010000:0.0:1776187968.550309:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.550310:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.550312:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 3/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550318:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 4/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550567:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.550583:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a3502aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+73:2223:x1862467653421824:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 310us (4762us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.550590:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4331 00010000:00010000:1.0:1776187968.550646:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.550649:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.550652:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 3/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.550660:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 4/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550660:0:11796:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ead050/0x92b1eb87ee4387d9 lrc: 0/0,0 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca81e expref: 74 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.550675:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.550694:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f1d31b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+72:2223:x1862467653421568:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 752us (4886us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.550700:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4329 00010000:00010000:1.0:1776187968.550738:0:11794:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000787e291/0x92b1eb87ee437587 lrc: 0/0,0 mode: --/PW res: [0x1a4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca21a expref: 73 pid: 6326 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.550745:0:11796:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000280e0900 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:11796:1862467659899200:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.550755:0:11794:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1d41ccf pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:11794:1862467659899072:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.550771:0:11796:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 3/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.550773:0:11794:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 3/0,1 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550791:0:11796:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 3/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.550792:0:11794:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 3/0,1 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.550809:0:11794:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 3/0,1 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550810:0:11796:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 3/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.550831:0:11794:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 3/0,1 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550831:0:11796:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 3/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.550850:0:11794:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 2/0,0 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550851:0:11796:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 2/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.550913:0:11796:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1776187968.550917:0:11794:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1776187968.551408:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.551859:0:11796:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ead899a8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:2994:x1862467659898176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25356us (26043us total) trans 4294968171 rc 0/0 00000100:00100000:0.0:1776187968.551902:0:11796:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2801 00000100:00100000:1.0:1776187968.551904:0:11794:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb31ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:2994:x1862467659897920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25701us (26114us total) trans 4294968172 rc 0/0 00000100:00100000:1.0:1776187968.551913:0:11794:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2800 00010000:00010000:0.0:1776187968.551932:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1776187968.551938:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 2/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.551939:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.551944:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 2/0,0 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.551949:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000059fd37 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.551954:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 2/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.551955:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6dd5963 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.551959:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 2/0,0 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.551967:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 3/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.551970:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 3/0,0 mode: PW/PW res: [0x1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.551985:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 1/0,0 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.551987:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 1/0,0 mode: --/PW res: [0x1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552001:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a2f9 lrc: 0/0,0 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.552003:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a2eb lrc: 0/0,0 mode: --/PW res: [0x1a4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552030:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.552032:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.552034:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.552036:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.552038:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.552040:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.552068:0:11829:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000008898d9/0x92b1eb87ee41d98a lrc: 0/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18dd expref: 72 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.552080:0:11829:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e127d529 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:11829:1862467659898688:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.552083:0:11797:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027716d25/0x92b1eb87ee41d65e lrc: 0/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1778 expref: 71 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.552097:0:11797:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089eb1245 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:11797:1862467659898368:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.552098:0:11829:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.552113:0:11797:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552114:0:11829:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.552132:0:11797:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552132:0:11829:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.552148:0:11797:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552148:0:11829:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.552175:0:11797:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552186:0:11829:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.552188:0:11797:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552214:0:11829:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1776187968.552294:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4317 00000100:00100000:2.0:1776187968.552360:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421888 00010000:00010000:2.0:1776187968.552382:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000017234a62/0x92b1eb87ee437a96 lrc: 5/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca3be expref: 72 pid: 11792 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.552407:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4332 00000100:00100000:2.0:1776187968.552413:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8f5ee10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+72:2224:x1862467653421888:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1776187968.552416:0:11797:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1776187968.552426:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.552431:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000017234a62/0x92b1eb87ee437a96 lrc: 5/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca3be expref: 72 pid: 11792 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.552444:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000017234a62/0x92b1eb87ee437a96 lrc: 4/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca3be expref: 72 pid: 11792 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.552462:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.552464:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.552467:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.552476:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 4/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.552496:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.552523:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8f5ee10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+72:2224:x1862467653421888:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 110us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.552531:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4332 00000100:00100000:0.0:1776187968.552606:0:11829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d1f0f2e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+13:2995:x1862467659898240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28074us (29007us total) trans 4294968173 rc 0/0 00000100:00100000:0.0:1776187968.552614:0:11829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2793 00010000:00010000:0.0:1776187968.552636:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1776187968.552639:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552646:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005f47f5e7 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.552648:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552653:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 3/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552666:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 1/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552672:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a2c1 lrc: 0/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552683:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.552685:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552690:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004fba2add already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.552691:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552696:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552703:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 1/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552708:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a29e lrc: 0/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552719:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.552720:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.552722:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.552727:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.552750:0:11826:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078973247/0x92b1eb87ee41d8c6 lrc: 0/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1889 expref: 71 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.552761:0:11826:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7d6744b pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:11826:1862467659898944:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.552777:0:11826:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552783:0:11826:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552788:0:11826:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552794:0:11826:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552799:0:11826:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.552816:0:11826:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.552931:0:11797:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a10603c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:2993:x1862467659897600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29875us (40722us total) trans 4294968135 rc 0/0 00000100:00100000:1.0:1776187968.552939:0:11797:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2788 00010000:00010000:1.0:1776187968.552981:0:11792:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edaaa4a3/0x92b1eb87ee41e14e lrc: 0/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bc3 expref: 69 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.552996:0:11792:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f965700f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:11792:1862467659899008:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.553011:0:11792:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.553018:0:11792:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.553025:0:11792:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.553031:0:11792:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.553038:0:11792:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.553054:0:11792:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1776187968.553791:0:11792:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005cd1bbde pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:2994:x1862467659897664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 27722us (28039us total) trans 4294968136 rc 0/0 00000100:00100000:1.0:1776187968.553805:0:11792:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2799 00000100:00100000:0.0:1776187968.553839:0:11826:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd946725 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+13:2996:x1862467659898304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28379us (30112us total) trans 4294968174 rc 0/0 00000100:00100000:0.0:1776187968.553848:0:11826:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2797 00000004:00080000:1.0:1776187968.553853:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000012c0d89e/2, rc 0, transno 839 00000100:00100000:1.0:1776187968.553869:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012c0d89e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659897600:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.553904:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1776187968.553910:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.553922:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.553926:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.553934:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.553949:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 1/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.553955:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a2dd lrc: 0/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.553970:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.553972:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.553978:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.553980:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.553986:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 3/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.553995:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 1/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.554001:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009615f87f/0x92b1eb87ee43a2e4 lrc: 0/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.554020:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.554021:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.554023:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.554031:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.554056:0:11795:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee437771 lrc: 0/0,0 mode: --/PW res: [0x1a5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca2b4 expref: 70 pid: 11792 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.554067:0:11795:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000025fccc35 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:11795:1862467659898624:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.554084:0:11795:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 3/0,1 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.554092:0:11795:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 3/0,1 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.554098:0:11795:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 3/0,1 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.554104:0:11795:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 3/0,1 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.554110:0:11795:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 2/0,0 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.554131:0:11795:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1776187968.554233:0:11825:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c64851a8/0x92b1eb87ee4388b2 lrc: 0/0,0 mode: --/PR res: [0x1aa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca864 expref: 68 pid: 11797 timeout: 545 lvb_type: 1 00000100:00100000:3.0:1776187968.554247:0:11825:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007eb3c018 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:11825:1862467659898496:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.554262:0:11825:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 3/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.554270:0:11825:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 3/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.554277:0:11825:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 3/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.554284:0:11825:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 3/0,1 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.554290:0:11825:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 2/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.554305:0:11825:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1776187968.554697:0:11825:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000894dc1df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+13:2995:x1862467659897472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30844us (31222us total) trans 4294968137 rc 0/0 00000100:00100000:3.0:1776187968.554705:0:11825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2790 00000100:00100000:3.0:1776187968.554742:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421056 00000100:00100000:3.0:1776187968.554782:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15434 00000100:00100000:3.0:1776187968.554788:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eb9d3d6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:11414:x1862467653421056:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187968.555002:0:11795:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000843473e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:2995:x1862467659897984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30595us (31431us total) trans 4294968175 rc 0/0 00000100:00100000:0.0:1776187968.555014:0:11795:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2792 00000100:00100000:3.0:1776187968.555018:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eb9d3d6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:11414:x1862467653421056:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 227us (9441us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.555027:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15434 00000004:00080000:0.0:1776187968.555058:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000053e106e4/2, rc 0, transno 878 00000100:00100000:0.0:1776187968.555072:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053e106e4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659898304:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.555174:0:11816:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094ea8a6e/0x92b1eb87ee41d7e6 lrc: 0/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1820 expref: 67 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.555187:0:11816:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b84092ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:11816:1862467659898752:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.555203:0:11816:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.555212:0:11816:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.555218:0:11816:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.555225:0:11816:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.555232:0:11816:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.555245:0:11816:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1776187968.556089:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000025fccc35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659899392:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1776187968.556114:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1776187968.556121:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 2/0,0 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556133:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.556137:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 2/0,0 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556146:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 3/0,0 mode: PW/PW res: [0x1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556181:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 1/0,0 mode: --/PW res: [0x1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556192:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a2ba lrc: 0/0,0 mode: --/PW res: [0x1a5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556210:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1776187968.556213:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 2/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556220:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a9283777 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.556222:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 2/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.556230:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006afce0ba pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:2996:x1862467659897536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31508us (32602us total) trans 4294968138 rc 0/0 00000100:00100000:3.0:1776187968.556240:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1776187968.556246:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 3/0,0 mode: PW/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.556249:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2794 00010000:00010000:1.0:1776187968.556265:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 1/0,0 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556270:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9283777/0x92b1eb87ee43a2ac lrc: 0/0,0 mode: --/PW res: [0x1aa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.556292:0:11816:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659899392 00000100:00100000:0.0:1776187968.556326:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2803 00000100:00100000:0.0:1776187968.556343:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e08d0c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:2993:x1862467659899392:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187968.556344:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421760 00002000:00080000:0.0:1776187968.556366:0:11816:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:235 count 1 00010000:00010000:1.0:1776187968.556372:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.556376:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556382:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059094af5 already unused, calling callback (00000000924fc23c) 00000100:00100000:2.0:1776187968.556385:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4520 00010000:00010000:1.0:1776187968.556387:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.556391:0:11816:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 3/0,1 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.556395:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8214581 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:11406:x1862467653421760:12345-192.168.204.20@tcp:35:rm.0 00010000:00010000:1.0:1776187968.556402:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 3/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556417:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 1/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.556418:0:11816:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000186c07b3/0x92b1eb87ee41d802 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1835 expref: 69 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556431:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a2c8 lrc: 0/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556445:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.556445:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.556447:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.556448:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.556451:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.556452:0:11816:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 4/0,1 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.556482:0:11816:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000186c07b3/0x92b1eb87ee41d802 lrc: 3/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1835 expref: 69 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.556496:0:11816:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000186c07b3/0x92b1eb87ee41d802 lrc: 4/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1835 expref: 69 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.556509:0:11816:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b84092ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:11816:1862467659899456:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.556567:0:11816:0:(client.c:2500:ptlrpc_set_wait()) set 000000001fe29203 going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.556581:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.556599:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8214581 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+43:11406:x1862467653421760:12345-192.168.204.20@tcp:35:rm.0 Request processed in 206us (10761us total) trans 4294975139 rc 0/0 00000100:00100000:2.0:1776187968.556609:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4520 00010000:00010000:0.0:1776187968.556609:0:11819:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5de679f/0x92b1eb87ee420670 lrc: 0/0,0 mode: --/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2ae2 expref: 66 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.556625:0:11819:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2203b2c pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:11819:1862467659898560:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.556651:0:11819:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 3/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.556658:0:10783:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000129b7547/0x92b1eb87ee437f9e lrc: 0/0,0 mode: --/PR res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca562 expref: 65 pid: 11824 timeout: 545 lvb_type: 1 00010000:00010000:0.0:1776187968.556662:0:11819:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 3/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.556675:0:10783:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000416f053d pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10783:1862467659899328:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.556690:0:11819:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 3/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.556699:0:11819:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 3/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.556702:0:10783:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 3/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.556713:0:11819:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 2/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.556717:0:10783:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 3/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.556729:0:10783:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 3/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.556736:0:10783:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 3/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.556736:0:11819:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187968.556745:0:10783:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 2/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556746:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.556752:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 2/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556760:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d612a45d already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.556762:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 2/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.556765:0:10783:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1776187968.556773:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 3/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556786:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 1/0,0 mode: --/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556793:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a2b3 lrc: 0/0,0 mode: --/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556807:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.556809:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 2/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556815:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cfd2bd90 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.556817:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 2/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556824:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 3/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556837:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 1/0,0 mode: --/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556842:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfd2bd90/0x92b1eb87ee43a297 lrc: 0/0,0 mode: --/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.556853:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.556854:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.556855:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.557128:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.557152:0:11790:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccad8d39/0x92b1eb87ee43848a lrc: 0/0,0 mode: --/PR res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6ff expref: 69 pid: 6326 timeout: 545 lvb_type: 1 00000100:00100000:0.0:1776187968.557174:0:11790:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000402a2b37 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659898880:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.557188:0:11790:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.557195:0:11790:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.557204:0:11790:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.557210:0:11790:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.557215:0:11790:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.557230:0:11790:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.557543:0:11790:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077c3b583 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:2996:x1862467659898048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32288us (33844us total) trans 4294968176 rc 0/0 00000100:00100000:0.0:1776187968.557551:0:11790:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2796 00010000:00010000:0.0:1776187968.557587:0:11818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017234a62/0x92b1eb87ee437a96 lrc: 0/0,0 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca3be expref: 68 pid: 11792 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.557599:0:11818:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000783ba691 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659899264:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.557611:0:11818:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.557619:0:11818:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.557624:0:11818:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557630:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.557636:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.557639:0:11818:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 3/0,1 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557652:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089ca4280 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.557654:0:11818:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557657:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557669:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.557675:0:11818:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1776187968.557683:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 1/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557690:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089ca4280/0x92b1eb87ee43a2d6 lrc: 0/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557705:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.557708:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557714:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.557717:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 2/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557722:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 3/0,0 mode: PW/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557731:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 1/0,0 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557737:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a300 lrc: 0/0,0 mode: --/PW res: [0x1a6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.557751:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.557752:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.557753:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.557994:0:10783:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006439688d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:2993:x1862467659897344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35015us (45856us total) trans 4294968139 rc 0/0 00000100:00100000:2.0:1776187968.558004:0:10783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2787 00000100:00100000:0.0:1776187968.558037:0:11818:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3eeab83 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+14:2993:x1862467659898112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31434us (45314us total) trans 4294968177 rc 0/0 00000100:00100000:0.0:1776187968.558044:0:11818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2802 00010000:00010000:0.0:1776187968.558069:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.558092:0:11824:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e52a3f56/0x92b1eb87ee4372af lrc: 0/0,0 mode: --/PW res: [0x1a3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca12c expref: 67 pid: 10783 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.558103:0:11824:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d41c77b6 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:11824:1862467659898432:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.558119:0:11824:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 3/0,1 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.558125:0:11824:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 3/0,1 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.558131:0:11824:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 3/0,1 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.558138:0:11824:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 3/0,1 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.558148:0:11824:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 2/0,0 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.558186:0:11819:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052710b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+13:2995:x1862467659897728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33981us (34642us total) trans 4294968140 rc 0/0 00000100:00100000:1.0:1776187968.558195:0:11819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2791 00010000:00010000:0.0:1776187968.559036:0:11824:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1776187968.559079:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000060f785d2/2, rc 0, transno 843 00000100:00100000:3.0:1776187968.559089:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000060f785d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659897344:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1776187968.559209:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000f9699837/2, rc 0, transno 881 00000100:00100000:3.0:1776187968.559221:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f9699837 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659898112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187968.559230:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1776187968.559247:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f965700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659899520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1776187968.559294:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1776187968.559390:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.559395:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 2/0,0 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.559405:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b23405f4 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.559408:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 2/0,0 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.559416:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 3/0,0 mode: PW/PW res: [0x1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.559434:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 1/0,0 mode: --/PW res: [0x1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.559440:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a2a5 lrc: 0/0,0 mode: --/PW res: [0x1a3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.559459:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.559461:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.559462:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.559611:0:6329:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002290ff93/0x92b1eb87ee41e488 lrc: 0/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d13 expref: 64 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.559628:0:6329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d81b363c pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6329:1862467659898816:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.559645:0:6329:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.559657:0:6329:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.559663:0:6329:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.559669:0:6329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.559675:0:6329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.559698:0:6329:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187968.559734:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.559739:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.559746:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e168beb already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.559748:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.559755:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 3/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.559768:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 1/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.559774:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a2cf lrc: 0/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.559787:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.559789:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.559790:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.560148:0:11824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f42d7af2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+14:2993:x1862467659897856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36878us (47895us total) trans 4294968178 rc 0/0 00000100:00100000:0.0:1776187968.560158:0:11824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2789 00000100:00100000:0.0:1776187968.560193:0:11824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659899520 00000100:00100000:0.0:1776187968.560223:0:11824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2804 00000100:00100000:0.0:1776187968.560228:0:11824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e144210c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+13:2993:x1862467659899520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.560252:0:11824:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:248 count 1 00010000:00010000:0.0:1776187968.560272:0:11824:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 3/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.560287:0:11824:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000133cc86a/0x92b1eb87ee41e728 lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e08 expref: 63 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.560295:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.560297:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.560299:0:11824:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 4/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.560323:0:11824:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000133cc86a/0x92b1eb87ee41e728 lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e08 expref: 63 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.560421:0:11824:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000133cc86a/0x92b1eb87ee41e728 lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e08 expref: 63 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.560512:0:11824:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000783ba691 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:11824:1862467659899648:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.560562:0:11824:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e9a55fb9 going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.560564:0:6329:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000046010e85 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:2996:x1862467659897792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35730us (36891us total) trans 4294968141 rc 0/0 00000100:00100000:1.0:1776187968.560573:0:6329:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2795 00000100:00100000:1.0:1776187968.560605:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1d41ccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659899584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.560612:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000402a2b37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659899712:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.560743:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1776187968.560750:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.560765:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659899584 00000004:00080000:1.0:1776187968.560792:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000c01fecec/2, rc 0, transno 841 00000100:00100000:0.0:1776187968.560800:0:11795:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2805 00000100:00100000:1.0:1776187968.560805:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c01fecec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659897472:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1776187968.560816:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000031f2b725/2, rc 0, transno 844 00000100:00100000:1.0:1776187968.560820:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031f2b725 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659897728:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1776187968.560828:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000b768e705/2, rc 0, transno 879 00000100:00100000:1.0:1776187968.560836:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b768e705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659897984:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1776187968.560845:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000ed0ab337/2, rc 0, transno 877 00000100:00100000:1.0:1776187968.560849:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ed0ab337 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659898240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.560918:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d2d18b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659899840:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.560941:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.560981:0:11795:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000226d82a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:2995:x1862467659899584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.560996:0:11795:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:270 count 1 00010000:00010000:0.0:1776187968.561009:0:11795:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 3/0,1 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1776187968.561018:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000024f833d6/2, rc 0, transno 840 00010000:00010000:0.0:1776187968.561019:0:11795:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006265e1c3/0x92b1eb87ee41faae lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25fd expref: 63 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.561027:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1776187968.561030:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024f833d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659897664:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.561030:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.561032:0:11795:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 4/0,1 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1776187968.561047:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000c493e10a/2, rc 0, transno 876 00000100:00100000:1.0:1776187968.561053:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c493e10a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659897920:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.561054:0:11795:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006265e1c3/0x92b1eb87ee41faae lrc: 3/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25fd expref: 63 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.561065:0:11795:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006265e1c3/0x92b1eb87ee41faae lrc: 4/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25fd expref: 63 pid: 11816 timeout: 545 lvb_type: 0 00000004:00080000:1.0:1776187968.561066:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000008dcb65fe/2, rc 0, transno 875 00000100:00100000:1.0:1776187968.561073:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008dcb65fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659898176:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.561079:0:11795:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2203b2c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:11795:1862467659899904:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.561082:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1776187968.561089:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dc0b983c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659899776:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.561105:0:11795:0:(client.c:2500:ptlrpc_set_wait()) set 000000000638ad3a going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.561116:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1776187968.561175:0:9338:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee4383bf lrc: 0/0,0 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca6b9 expref: 63 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.561189:0:9338:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000088bac792 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9338:1862467659899136:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.561197:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1776187968.561207:0:9338:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 3/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.561216:0:9338:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 3/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.561222:0:9338:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 3/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1776187968.561224:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000812af665/2, rc 0, transno 842 00000100:00100000:0.0:1776187968.561232:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000812af665 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659897536:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.561242:0:9338:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 3/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1776187968.561246:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000008b1fba72/2, rc 0, transno 845 00010000:00010000:1.0:1776187968.561249:0:9338:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.561252:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008b1fba72 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659897792:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1776187968.561266:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000004f16eb28/2, rc 0, transno 880 00010000:00010000:1.0:1776187968.561271:0:9338:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.561288:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f16eb28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659898048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.561299:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e127d529 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659900032:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.561323:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.561503:0:9338:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e88f43fc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:2994:x1862467659897408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35579us (35919us total) trans 4294968142 rc 0/0 00000100:00100000:1.0:1776187968.561510:0:9338:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2798 00000100:00100000:1.0:1776187968.561524:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659899840 00000100:00100000:1.0:1776187968.561542:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659899776 00000100:00100000:1.0:1776187968.561554:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659899712 00000100:00100000:0.0:1776187968.561568:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1776187968.561570:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659900032 00000100:00100000:0.0:1776187968.561576:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c7d6744b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659899968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.561589:0:9338:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2806 00000100:00100000:1.0:1776187968.561594:0:9338:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a205269b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:2994:x1862467659899840:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.561603:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1776187968.561606:0:9338:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:266 count 1 00010000:00010000:1.0:1776187968.561618:0:9338:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 3/0,1 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.561724:0:9338:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009bfba106/0x92b1eb87ee41f7b3 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24bb expref: 62 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.561732:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.561733:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.561735:0:9338:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 4/0,1 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.561795:0:9338:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009bfba106/0x92b1eb87ee41f7b3 lrc: 3/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24bb expref: 62 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.561795:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6d51526 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659900224:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1776187968.561809:0:9338:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009bfba106/0x92b1eb87ee41f7b3 lrc: 4/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24bb expref: 62 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.561818:0:9338:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6e3f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9338:1862467659900288:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.561828:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.561849:0:9338:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026fd70c8 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.561871:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000060cbfe30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659900160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187968.561901:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.561970:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.562037:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659899968 00000100:00100000:1.0:1776187968.562063:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659900224 00000100:00100000:1.0:1776187968.562083:0:11825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2807 00000100:00100000:1.0:1776187968.562089:0:11825:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e3eea26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+16:2994:x1862467659899776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.562101:0:11825:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:249 count 1 00010000:00010000:1.0:1776187968.562112:0:11825:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 3/0,1 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.562122:0:11825:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa80b752/0x92b1eb87ee41e7fa lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e63 expref: 62 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.562127:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.562128:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.562130:0:11825:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 4/0,1 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.562145:0:11825:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa80b752/0x92b1eb87ee41e7fa lrc: 3/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e63 expref: 62 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.562157:0:11825:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa80b752/0x92b1eb87ee41e7fa lrc: 4/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e63 expref: 62 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.562285:0:11818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2808 00000100:00100000:2.0:1776187968.562291:0:11818:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e587155 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+17:2996:x1862467659899712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187968.562308:0:11818:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:261 count 1 00010000:00010000:2.0:1776187968.562322:0:11818:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 3/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.562333:0:11818:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000447538cf/0x92b1eb87ee41f170 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2253 expref: 66 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.562339:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.562341:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.562342:0:11818:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 4/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.562358:0:11818:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000447538cf/0x92b1eb87ee41f170 lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2253 expref: 66 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.562366:0:11818:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000447538cf/0x92b1eb87ee41f170 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2253 expref: 66 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.562376:0:11818:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c57b803b pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659900608:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.562407:0:11818:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c87ea308 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.562536:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1776187968.562560:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000000346ea37/2, rc 0, transno 846 00000100:00100000:0.0:1776187968.562579:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000346ea37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659897408:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.562589:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d41c77b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659900480:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.562606:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.562613:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1776187968.562617:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000280e0900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659900096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.562632:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.562637:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000818d4c03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659900416:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.562650:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.562751:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659900160 00000100:00100000:3.0:1776187968.562756:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.562769:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659900480 00000100:00100000:0.0:1776187968.562776:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659900096 00000100:00100000:0.0:1776187968.562783:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659900416 00000100:00100000:0.0:1776187968.562794:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2809 00000100:00100000:0.0:1776187968.562800:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab63205d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:2996:x1862467659900032:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.562808:0:11825:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089eb1245 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:11825:1862467659900544:192.168.204.20@tcp:104: 00002000:00080000:0.0:1776187968.562815:0:6326:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:259 count 1 00010000:00010000:0.0:1776187968.562830:0:6326:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 3/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.562839:0:11825:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ae9f50cc going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.562843:0:6326:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0a9a48e/0x92b1eb87ee41efb0 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c219d expref: 66 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.562851:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.562853:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.562855:0:6326:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 4/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.562862:0:11827:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2810 00000100:00100000:1.0:1776187968.562867:0:11827:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008729ebb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+19:2996:x1862467659899968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.562900:0:11827:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:260 count 1 00010000:00010000:1.0:1776187968.562915:0:11827:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 3/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.562925:0:11827:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000946e8fee/0x92b1eb87ee41f0ac lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2206 expref: 66 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.562931:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1776187968.562933:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653421952 00010000:00010000:1.0:1776187968.562933:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.562937:0:11827:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 4/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.562960:0:11827:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000946e8fee/0x92b1eb87ee41f0ac lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2206 expref: 66 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.562965:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422080 00000100:00100000:3.0:1776187968.562986:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15435 00000100:00100000:3.0:1776187968.562990:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082dfa6ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+44:11414:x1862467653421952:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187968.563186:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082dfa6ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+44:11414:x1862467653421952:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 193us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.563195:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15435 00010000:00010000:0.0:1776187968.563204:0:6326:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0a9a48e/0x92b1eb87ee41efb0 lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c219d expref: 66 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.563213:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15436 00010000:00010000:0.0:1776187968.563216:0:6326:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0a9a48e/0x92b1eb87ee41efb0 lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c219d expref: 66 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.563223:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071c80bbe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+43:11406:x1862467653422080:12345-192.168.204.20@tcp:36:rm.0 00000100:00100000:0.0:1776187968.563235:0:6326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000416f053d pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6326:1862467659900800:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.563264:0:6326:0:(client.c:2500:ptlrpc_set_wait()) set 000000009e29dcf9 going to sleep for 43 seconds 00010000:00010000:3.0:1776187968.563266:0:5517:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1776187968.563292:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a31c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac31 expref: 43 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.563296:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003ca7af7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659900672:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1776187968.563316:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee439f95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cab9e expref: 42 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.563328:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (000000003d48dd25) 00010000:00010000:3.0:1776187968.563344:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee439d7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24caae8 expref: 41 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.563356:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000007616c5c6) 00010000:00010000:3.0:1776187968.563360:0:5517:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187968.563388:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a35b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.563399:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a35b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.563408:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a35b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.563418:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.563424:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.563429:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.563522:0:5517:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.563530:0:5517:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.563537:0:5517:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.563851:0:11827:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000946e8fee/0x92b1eb87ee41f0ac lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2206 expref: 66 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.563866:0:11827:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c1aac22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:11827:1862467659900736:192.168.204.20@tcp:104: 00000040:00080000:3.0:1776187968.564020:0:5517:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4763, 176 off837872 00000004:00200000:3.0:1776187968.564070:0:5517:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1f1:0x0]: returning size 11776 00000004:00010000:3.0:1776187968.564083:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000071c80bbe reply state 0000000087f1322d transno 4294975140 ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.564117:0:5517:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a35b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.564124:0:5517:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a35b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.564129:0:5517:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a35b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.564134:0:5517:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007dfea8c8 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.564137:0:5517:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a35b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.564143:0:5517:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a35b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.564151:0:5517:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000005aa30e07) 00010000:00010000:3.0:1776187968.564154:0:5517:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.564156:0:5517:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a35b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.564173:0:5517:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a35b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1776187968.564186:0:5517:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 0000000071c80bbe reply state 0000000087f1322d transno 4294975140 ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.564229:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071c80bbe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:11406:x1862467653422080:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1008us (2260us total) trans 4294975140 rc 0/0 00000100:00100000:3.0:1776187968.564236:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15436 00000100:00100000:1.0:1776187968.564365:0:11827:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e63b39b0 going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.564396:0:6329:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2811 00000100:00100000:1.0:1776187968.564402:0:6329:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df83f436 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:2995:x1862467659900224:12345-0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1776187968.564420:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000eb462d1a/2, rc 0, transno 882 00002000:00080000:1.0:1776187968.564424:0:6329:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:245 count 1 00000100:00100000:3.0:1776187968.564436:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eb462d1a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659897856:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1776187968.564440:0:6329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 3/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564454:0:6329:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000090b816d5/0x92b1eb87ee41e30e lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c79 expref: 66 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.564455:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1776187968.564463:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.564465:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.564467:0:6329:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 4/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.564483:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1776187968.564492:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000617a485f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659900352:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.564500:0:6329:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000090b816d5/0x92b1eb87ee41e30e lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c79 expref: 66 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564510:0:6329:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000090b816d5/0x92b1eb87ee41e30e lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c79 expref: 66 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.564519:0:6329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000025fca930 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6329:1862467659900864:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.564526:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.564567:0:6329:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e8587547 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.564585:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1776187968.564589:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1776187968.564594:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050e0db89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659900928:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1776187968.564596:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564605:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a152635 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.564608:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564615:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 3/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.564622:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1776187968.564637:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 1/0,0 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564644:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a2f2 lrc: 0/0,0 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.564657:0:11790:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659900672 00010000:00010000:1.0:1776187968.564662:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.564664:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.564666:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.564680:0:11794:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659900352 00000100:00100000:1.0:1776187968.564700:0:11794:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659900928 00000100:00100000:1.0:1776187968.564710:0:11794:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2812 00000100:00100000:1.0:1776187968.564714:0:11794:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088bac792 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:2994:x1862467659900160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.564726:0:11794:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:424 count 1 00010000:00010000:1.0:1776187968.564735:0:11794:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 3/0,1 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564745:0:11794:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee438173 lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca5ee expref: 66 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564750:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.564751:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.564753:0:11794:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 4/0,1 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564769:0:11794:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee438173 lrc: 3/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca5ee expref: 66 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564776:0:11794:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee438173 lrc: 4/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca5ee expref: 66 pid: 6326 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.564785:0:11794:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd1918da pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:11794:1862467659900992:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.564807:0:11794:0:(client.c:2500:ptlrpc_set_wait()) set 000000009e2d7a44 going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.564838:0:11819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2813 00000100:00100000:1.0:1776187968.564844:0:11819:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d81b363c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+20:2994:x1862467659900480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.564858:0:11819:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:250 count 1 00010000:00010000:1.0:1776187968.564871:0:11819:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 3/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564902:0:11819:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073e95615/0x92b1eb87ee41e8c5 lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ebe expref: 62 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564909:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.564910:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.564912:0:11819:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 4/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564944:0:11819:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073e95615/0x92b1eb87ee41e8c5 lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ebe expref: 62 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.564954:0:11819:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073e95615/0x92b1eb87ee41e8c5 lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ebe expref: 62 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.564960:0:11790:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2814 00000100:00100000:0.0:1776187968.564968:0:11790:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f465fce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:2994:x1862467659900096:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.564970:0:11819:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007929426f pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:11819:1862467659901056:192.168.204.20@tcp:104: 00002000:00080000:0.0:1776187968.564985:0:11790:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:418 count 1 00000100:00100000:1.0:1776187968.564998:0:11819:0:(client.c:2500:ptlrpc_set_wait()) set 000000004a0117dc going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.564999:0:11790:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 3/0,1 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.565011:0:11790:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee436ec6 lrc: 2/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9ff1 expref: 66 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.565017:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1776187968.565018:0:11797:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2815 00010000:00010000:0.0:1776187968.565020:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.565023:0:11790:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 4/0,1 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.565027:0:11797:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007eb3c018 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:2994:x1862467659900416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.565048:0:11797:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:269 count 1 00010000:00010000:0.0:1776187968.565051:0:11790:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee436ec6 lrc: 3/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9ff1 expref: 66 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.565061:0:11797:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 3/0,1 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.565061:0:11790:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee436ec6 lrc: 4/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9ff1 expref: 66 pid: 10783 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.565085:0:11797:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa79097e/0x92b1eb87ee41f9ea lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25a9 expref: 62 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.565088:0:11790:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008fd1dad5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659901120:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.565097:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.565098:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.565100:0:11797:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 4/0,1 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.565119:0:11790:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c391d1e7 going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.565121:0:11797:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa79097e/0x92b1eb87ee41f9ea lrc: 3/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25a9 expref: 62 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.565132:0:11797:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa79097e/0x92b1eb87ee41f9ea lrc: 4/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25a9 expref: 62 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.565139:0:11826:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2816 00000100:00100000:1.0:1776187968.565142:0:11797:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ea1a11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:11797:1862467659901184:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.565147:0:11826:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ba2a942 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+20:2995:x1862467659900352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.565174:0:11826:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:247 count 1 00010000:00010000:0.0:1776187968.565186:0:11826:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 3/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.565197:0:11826:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a0dca7c/0x92b1eb87ee41e62c lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1da6 expref: 62 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.565203:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.565204:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.565205:0:11826:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 4/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.565222:0:11826:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a0dca7c/0x92b1eb87ee41e62c lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1da6 expref: 62 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.565230:0:11826:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a0dca7c/0x92b1eb87ee41e62c lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1da6 expref: 62 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.565238:0:11826:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a4e5517 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:11826:1862467659901248:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.565284:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422144 00010000:00010000:2.0:1776187968.565306:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000186c07b3/0x92b1eb87ee41d802 lrc: 5/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1835 expref: 67 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.565332:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4333 00000100:00100000:2.0:1776187968.565337:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000007a50378 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+67:2223:x1862467653422144:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.565347:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.565351:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000186c07b3/0x92b1eb87ee41d802 lrc: 5/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1835 expref: 67 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.565361:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000186c07b3/0x92b1eb87ee41d802 lrc: 4/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1835 expref: 67 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.565379:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.565381:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.565383:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.565391:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 4/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.565406:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.565728:0:11797:0:(client.c:2500:ptlrpc_set_wait()) set 00000000224b65d3 going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.565752:0:11792:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2817 00000100:00100000:1.0:1776187968.565758:0:11792:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d74ae161 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:2995:x1862467659900928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.565773:0:11792:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:246 count 1 00010000:00010000:1.0:1776187968.565785:0:11792:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 3/0,1 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.565796:0:11792:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000623703fc/0x92b1eb87ee41e3d2 lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ccd expref: 67 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.565802:0:11792:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.565803:0:11792:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.565804:0:11792:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 4/0,1 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.565826:0:11792:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000623703fc/0x92b1eb87ee41e3d2 lrc: 3/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ccd expref: 67 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.565829:0:11826:0:(client.c:2500:ptlrpc_set_wait()) set 00000000969e28c2 going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.565837:0:11792:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000623703fc/0x92b1eb87ee41e3d2 lrc: 4/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ccd expref: 67 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.565848:0:11792:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e059535c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:11792:1862467659901312:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.565854:0:11829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2818 00000100:00100000:0.0:1776187968.565860:0:11829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008599647e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+20:2995:x1862467659900672:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.565894:0:11792:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eb311790 going to sleep for 43 seconds 00002000:00080000:0.0:1776187968.565900:0:11829:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:267 count 1 00010000:00010000:0.0:1776187968.565915:0:11829:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 3/0,1 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.565925:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000007a50378 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+67:2223:x1862467653422144:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 582us (3833us total) trans 0 rc 0/0 00010000:00010000:0.0:1776187968.565932:0:11829:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c12ffce5/0x92b1eb87ee41f885 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c250f expref: 62 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.565939:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4333 00010000:00010000:0.0:1776187968.565944:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.565946:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.565947:0:11829:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 4/0,1 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.565968:0:11829:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c12ffce5/0x92b1eb87ee41f885 lrc: 3/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c250f expref: 62 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.565976:0:11829:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c12ffce5/0x92b1eb87ee41f885 lrc: 4/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c250f expref: 62 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.565985:0:11829:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028e219af pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:11829:1862467659901376:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.566004:0:11829:0:(client.c:2500:ptlrpc_set_wait()) set 00000000598bef03 going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.566037:0:11816:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186c07b3/0x92b1eb87ee41d802 lrc: 0/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1835 expref: 67 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.566050:0:11816:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b84092ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:11816:1862467659899456:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.566068:0:11816:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.566082:0:11816:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.566087:0:11816:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.566095:0:11816:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.566100:0:11816:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.566130:0:11816:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1776187968.566548:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.566554:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.566562:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000033a084bb already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.566565:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.566577:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 3/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.566593:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 1/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.566598:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a323 lrc: 0/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.566613:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.566614:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.566615:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.567740:0:11824:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000783ba691 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:11824:1862467659899648:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.567769:0:11824:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 3/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.567798:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.568269:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e08d0c88 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:2993:x1862467659899392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11924us (12032us total) trans 4294968179 rc 0/0 00000100:00100000:0.0:1776187968.568280:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2803 00000100:00100000:0.0:1776187968.568328:0:11795:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2203b2c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:11795:1862467659899904:192.168.204.20@tcp:104: 00000004:00080000:2.0:1776187968.568395:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000025fccc35/2, rc 0, transno 883 00000100:00100000:2.0:1776187968.568406:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000025fccc35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659899392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.568477:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422208 00010000:00010000:1.0:1776187968.568506:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000133cc86a/0x92b1eb87ee41e728 lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e08 expref: 63 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.568529:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.568769:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.568797:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422272 00010000:00010000:1.0:1776187968.568814:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006265e1c3/0x92b1eb87ee41faae lrc: 4/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25fd expref: 64 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.568838:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4334 00000100:00100000:1.0:1776187968.568843:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d65b5018 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+64:2222:x1862467653422208:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1776187968.568858:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.568862:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000133cc86a/0x92b1eb87ee41e728 lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e08 expref: 64 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.568872:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000133cc86a/0x92b1eb87ee41e728 lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e08 expref: 64 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.568916:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000133cc86a/0x92b1eb87ee41e728 lrc: 0/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e08 expref: 64 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.568929:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.568931:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.568934:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.568942:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 4/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.568965:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.568994:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d65b5018 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+63:2222:x1862467653422208:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 150us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.569001:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4334 00000100:00100000:1.0:1776187968.569016:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4335 00000100:00100000:1.0:1776187968.569020:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e13c69aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+62:2225:x1862467653422272:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1776187968.569027:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.569030:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006265e1c3/0x92b1eb87ee41faae lrc: 4/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25fd expref: 62 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.569049:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006265e1c3/0x92b1eb87ee41faae lrc: 3/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25fd expref: 62 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.569062:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006265e1c3/0x92b1eb87ee41faae lrc: 0/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25fd expref: 62 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.569070:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.569072:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.569073:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569079:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 4/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569090:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.569106:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e13c69aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+61:2225:x1862467653422272:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 85us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.569112:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4335 00000100:00100000:1.0:1776187968.569145:0:9338:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6e3f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9338:1862467659900288:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.569151:0:11795:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.569172:0:11795:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569173:0:9338:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 3/0,1 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.569187:0:11795:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569199:0:11824:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.569203:0:11795:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569209:0:11824:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.569215:0:11795:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569220:0:11824:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569230:0:11824:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.569237:0:11795:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1776187968.569243:0:11824:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1776187968.569614:0:11824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e144210c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+21:2993:x1862467659899520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9385us (10320us total) trans 4294968143 rc 0/0 00000100:00100000:1.0:1776187968.569621:0:11824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2804 00010000:00010000:1.0:1776187968.569639:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1776187968.569643:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569650:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005f47f5e7 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.569653:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569660:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 3/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569670:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 1/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569675:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a331 lrc: 0/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569692:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.569694:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569699:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004fba2add already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.569700:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569705:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569711:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 1/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569716:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a32a lrc: 0/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.569725:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.569726:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.569727:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1776187968.569853:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000f965700f/2, rc 0, transno 847 00000100:00100000:1.0:1776187968.569866:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f965700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659899520:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.569952:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000060a1c46b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659901440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.569991:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.570018:0:11824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659901440 00000100:00100000:0.0:1776187968.570035:0:11795:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000226d82a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:2995:x1862467659899584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9055us (9292us total) trans 4294968144 rc 0/0 00000100:00100000:0.0:1776187968.570043:0:11795:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2805 00000100:00100000:1.0:1776187968.570052:0:11824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2819 00000100:00100000:1.0:1776187968.570059:0:11824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005359ef33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+21:2993:x1862467659901440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.570081:0:11824:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:276 count 1 00010000:00010000:0.0:1776187968.570083:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.570103:0:11824:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 3/0,1 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.570117:0:11824:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000adfc180f/0x92b1eb87ee41ff8c lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c280a expref: 60 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.570123:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.570125:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.570127:0:11824:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 4/0,1 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1776187968.570135:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000a1d41ccf/2, rc 0, transno 848 00010000:00010000:1.0:1776187968.570149:0:11824:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000adfc180f/0x92b1eb87ee41ff8c lrc: 3/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c280a expref: 60 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.570149:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1d41ccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659899584:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.570173:0:11824:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000adfc180f/0x92b1eb87ee41ff8c lrc: 4/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c280a expref: 60 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.570183:0:11824:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e42c13a pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:11824:1862467659901568:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.570206:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2203b2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659901632:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.570223:0:11824:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e9a55fb9 going to sleep for 6 seconds 00000100:00100000:1.0:1776187968.570236:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1776187968.570240:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.570247:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000bf0cc0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659901504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.570276:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.570294:0:6328:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659901632 00000100:00100000:1.0:1776187968.570306:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659901504 00000100:00100000:0.0:1776187968.570323:0:6328:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2820 00000100:00100000:1.0:1776187968.570330:0:11796:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2821 00000100:00100000:1.0:1776187968.570335:0:11796:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007dcbae96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:2993:x1862467659901504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.570347:0:11796:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:244 count 1 00010000:00010000:1.0:1776187968.570361:0:11796:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 3/0,1 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.570371:0:11796:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000096ab87b5/0x92b1eb87ee41e251 lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c2c expref: 65 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.570376:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.570377:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.570378:0:11796:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 4/0,1 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.570393:0:11796:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000096ab87b5/0x92b1eb87ee41e251 lrc: 3/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c2c expref: 65 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.570400:0:11796:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000096ab87b5/0x92b1eb87ee41e251 lrc: 4/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c2c expref: 65 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.570408:0:11796:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d31b3e8a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:11796:1862467659901696:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.570426:0:11796:0:(client.c:2500:ptlrpc_set_wait()) set 000000000638ad3a going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.570520:0:6328:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000783ba691 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:2995:x1862467659901632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.570534:0:6328:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:271 count 1 00010000:00010000:0.0:1776187968.570546:0:6328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 3/0,1 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.570557:0:6328:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076b154d1/0x92b1eb87ee41fb72 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2651 expref: 60 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.570565:0:6328:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.570566:0:6328:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.570567:0:6328:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 4/0,1 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.570586:0:6328:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076b154d1/0x92b1eb87ee41fb72 lrc: 3/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2651 expref: 60 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.570593:0:6328:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076b154d1/0x92b1eb87ee41fb72 lrc: 4/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2651 expref: 60 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.570602:0:6328:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b84092ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6328:1862467659901760:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.570625:0:6328:0:(client.c:2500:ptlrpc_set_wait()) set 000000008c92170b going to sleep for 6 seconds 00000100:00100000:3.0:1776187968.570821:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.571025:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422400 00000100:00100000:1.0:1776187968.571057:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15437 00000100:00100000:1.0:1776187968.571061:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcbe5f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:11414:x1862467653422400:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.572067:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcbe5f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:11414:x1862467653422400:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 1002us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.572078:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15437 00010000:00010000:3.0:1776187968.572420:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.572423:0:11825:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089eb1245 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:11825:1862467659900544:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.572432:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572439:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572444:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ac819bc1 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.572446:0:11825:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 3/0,1 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572447:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572456:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572476:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x12eaac0d (000000006f67d5a2) 00010000:00010000:3.0:1776187968.572479:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.572483:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572489:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a362 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ea:0x0].0x12eaac0d bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572508:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572513:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572518:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572523:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000005bf1cdd already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.572525:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572531:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572538:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f1:0x0].0x0 (00000000d2ce93fe) 00010000:00010000:3.0:1776187968.572541:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187968.572542:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.572552:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a369 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.572944:0:6326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000416f053d pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6326:1862467659900800:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.572961:0:6326:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 3/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.574365:0:11818:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c57b803b pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659900608:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.574392:0:11818:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 3/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.574481:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422336 00010000:00010000:2.0:1776187968.574515:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009bfba106/0x92b1eb87ee41f7b3 lrc: 4/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24bb expref: 61 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.574556:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4336 00000100:00100000:2.0:1776187968.574562:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7aa3d8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+61:2225:x1862467653422336:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1776187968.574574:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.574578:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009bfba106/0x92b1eb87ee41f7b3 lrc: 4/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24bb expref: 61 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.574587:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009bfba106/0x92b1eb87ee41f7b3 lrc: 3/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24bb expref: 61 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.574606:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bfba106/0x92b1eb87ee41f7b3 lrc: 0/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24bb expref: 61 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.574619:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.574620:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.574623:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.574631:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 4/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.574695:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.574747:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7aa3d8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+60:2225:x1862467653422336:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 184us (5979us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.574754:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4336 00010000:00010000:1.0:1776187968.574797:0:9338:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.574806:0:9338:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.574816:0:9338:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.574822:0:9338:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.574894:0:9338:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.575229:0:9338:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a205269b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:2994:x1862467659899840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13634us (14287us total) trans 4294968145 rc 0/0 00000100:00100000:1.0:1776187968.575238:0:9338:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2806 00010000:00010000:2.0:1776187968.575588:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.575593:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.575601:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6dd5963 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.575605:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.575612:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 3/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.575627:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 1/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.575632:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6dd5963/0x92b1eb87ee43a338 lrc: 0/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.575648:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.575650:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.575651:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.576055:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.576088:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.576106:0:11827:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c1aac22 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:11827:1862467659900736:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.576126:0:11827:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 3/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.576185:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.576213:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422464 00000100:00100000:3.0:1776187968.576220:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422592 00010000:00010000:2.0:1776187968.576236:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000447538cf/0x92b1eb87ee41f170 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2253 expref: 67 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.576239:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a9a48e/0x92b1eb87ee41efb0 lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c219d expref: 67 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.576270:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422528 00010000:00010000:3.0:1776187968.576279:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa80b752/0x92b1eb87ee41e7fa lrc: 4/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e63 expref: 60 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.576322:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.576428:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422656 00010000:00010000:2.0:1776187968.576443:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000946e8fee/0x92b1eb87ee41f0ac lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2206 expref: 68 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.576446:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.576466:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4337 00000100:00100000:2.0:1776187968.576477:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000030fe3c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+68:2225:x1862467653422592:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00000100:00100000:1.0:1776187968.576477:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4338 00000100:00100000:1.0:1776187968.576484:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ddc6d453 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+68:2225:x1862467653422464:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.576492:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.576494:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.576499:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0a9a48e/0x92b1eb87ee41efb0 lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c219d expref: 68 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.576500:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000447538cf/0x92b1eb87ee41f170 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2253 expref: 68 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.576523:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000447538cf/0x92b1eb87ee41f170 lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2253 expref: 68 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.576526:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0a9a48e/0x92b1eb87ee41efb0 lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c219d expref: 68 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.576550:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000447538cf/0x92b1eb87ee41f170 lrc: 0/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2253 expref: 68 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.576552:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a9a48e/0x92b1eb87ee41efb0 lrc: 0/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c219d expref: 68 pid: 11816 timeout: 545 lvb_type: 0 00000004:00080000:0.0:1776187968.576554:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000002d2d18b4/2, rc 0, transno 849 00010000:00010000:2.0:1776187968.576568:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.576571:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1776187968.576571:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d2d18b4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659899840:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1776187968.576575:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.576585:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 4/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.576595:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4339 00000100:00100000:0.0:1776187968.576601:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca963743 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+60:2225:x1862467653422528:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1776187968.576608:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.576612:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.576618:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa80b752/0x92b1eb87ee41e7fa lrc: 4/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e63 expref: 60 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.576623:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.576625:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.576633:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa80b752/0x92b1eb87ee41e7fa lrc: 3/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e63 expref: 60 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.576644:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000030fe3c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+66:2225:x1862467653422592:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 170us (555us total) trans 0 rc 0/0 00010000:00010000:0.0:1776187968.576651:0:11842:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa80b752/0x92b1eb87ee41e7fa lrc: 0/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e63 expref: 60 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.576655:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4337 00000100:00100000:2.0:1776187968.576674:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4340 00010000:00010000:0.0:1776187968.576677:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1776187968.576680:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f85f7282 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+65:2225:x1862467653422656:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.576681:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.576684:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.576689:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.576692:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 4/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.576694:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000946e8fee/0x92b1eb87ee41f0ac lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2206 expref: 65 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.576709:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.576724:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.576727:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 4/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.576730:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000946e8fee/0x92b1eb87ee41f0ac lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2206 expref: 65 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.576746:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca963743 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+59:2225:x1862467653422528:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 144us (562us total) trans 0 rc 0/0 00010000:00010000:2.0:1776187968.576753:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000946e8fee/0x92b1eb87ee41f0ac lrc: 0/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2206 expref: 65 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.576756:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4339 00010000:00010000:1.0:1776187968.576757:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.576769:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.576771:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.576774:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.576781:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 4/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.576789:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ddc6d453 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+64:2225:x1862467653422464:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 302us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.576798:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4338 00010000:00010000:2.0:1776187968.576805:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.576825:0:6326:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.576830:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f85f7282 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+63:2225:x1862467653422656:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 148us (508us total) trans 0 rc 0/0 00010000:00010000:1.0:1776187968.576839:0:6326:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.576845:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4340 00000100:00100000:0.0:1776187968.576848:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7b8745b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659901824:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.576856:0:6326:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.576864:0:6326:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.576908:0:6326:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.576918:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1776187968.576968:0:11825:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.576978:0:11825:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.576985:0:11825:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.576991:0:11825:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.577016:0:11825:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1776187968.577095:0:11827:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.577104:0:11827:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.577112:0:11827:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577122:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1776187968.577123:0:11827:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577128:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577137:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000059fd37 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.577140:0:11827:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1776187968.577141:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577150:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577177:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 1/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577183:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a34d lrc: 0/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577206:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1776187968.577210:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577216:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e4a55c8f already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.577219:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577225:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 3/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577236:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 1/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577243:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4a55c8f/0x92b1eb87ee43a33f lrc: 0/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577310:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.577313:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577321:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003af34d45 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.577326:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577334:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577348:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 1/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577353:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003af34d45/0x92b1eb87ee43a354 lrc: 0/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.577365:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.577366:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.577368:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.577389:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.577614:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab63205d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:2996:x1862467659900032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14813us (16290us total) trans 4294968180 rc 0/0 00000100:00100000:2.0:1776187968.577622:0:11827:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008729ebb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+23:2996:x1862467659899968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14752us (16018us total) trans 4294968181 rc 0/0 00000100:00100000:1.0:1776187968.577625:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2809 00000100:00100000:1.0:1776187968.577656:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659901824 00000100:00100000:2.0:1776187968.577659:0:11827:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2810 00000100:00100000:2.0:1776187968.577683:0:11827:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2822 00000004:00080000:3.0:1776187968.577686:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000c7d6744b/2, rc 0, transno 885 00000100:00100000:2.0:1776187968.577689:0:11827:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000890f1430 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+23:2996:x1862467659901824:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1776187968.577700:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c7d6744b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659899968:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1776187968.577711:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000e127d529/2, rc 0, transno 884 00002000:00080000:2.0:1776187968.577712:0:11827:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:265 count 1 00000100:00100000:3.0:1776187968.577715:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e127d529 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659900032:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1776187968.577734:0:11827:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 3/0,1 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.577748:0:11827:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2b3a4f4/0x92b1eb87ee41f72e lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2475 expref: 58 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.577755:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.577756:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.577758:0:11827:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 4/0,1 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.577781:0:11827:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2b3a4f4/0x92b1eb87ee41f72e lrc: 3/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2475 expref: 58 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.577792:0:11827:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2b3a4f4/0x92b1eb87ee41f72e lrc: 4/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2475 expref: 58 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.577809:0:11827:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d65b5018 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:11827:1862467659901888:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.577854:0:11827:0:(client.c:2500:ptlrpc_set_wait()) set 00000000815a23fa going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.577907:0:11818:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.577915:0:11818:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.577922:0:11818:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.577928:0:11818:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.578217:0:11818:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187968.578220:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.578225:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.578233:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089fb6120 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.578236:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.578243:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.578257:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 1/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.578263:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089fb6120/0x92b1eb87ee43a346 lrc: 0/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.578358:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.578360:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.578361:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.578452:0:11818:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e587155 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+22:2996:x1862467659899712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16160us (17256us total) trans 4294968182 rc 0/0 00000100:00100000:1.0:1776187968.578458:0:11818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2808 00010000:00010000:1.0:1776187968.578475:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.578486:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422784 00000100:00100000:1.0:1776187968.578513:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15438 00000100:00100000:1.0:1776187968.578519:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002467f7d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+41:11406:x1862467653422784:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:1.0:1776187968.578557:0:12471:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:0.0:1776187968.578598:0:11825:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e3eea26 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+24:2994:x1862467659899776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16507us (17479us total) trans 4294968146 rc 0/0 00000100:00100000:0.0:1776187968.578606:0:11825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2807 00000004:00080000:2.0:1776187968.578615:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000dc0b983c/2, rc 0, transno 850 00000100:00100000:2.0:1776187968.578631:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dc0b983c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659899776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1776187968.578674:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000037e2dad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659901952:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187968.578706:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1776187968.578909:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000402a2b37/2, rc 0, transno 886 00010000:00010000:1.0:1776187968.579384:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d1653154/0x92b1eb87ee4206cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1eb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b0c expref: 41 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.579403:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000005e4fa0af/0x92b1eb87ee41cbd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1eb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c13ff expref: 40 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.579413:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001ef64246/0x92b1eb87ee41cbbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1eb:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c13f8 expref: 39 pid: 10981 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.579422:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1eb:0x0].0x0 (000000000c684cb4) 00010000:00010000:1.0:1776187968.579430:0:12471:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.579459:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a3c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.579471:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a3c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.579479:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a3c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.579489:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.579495:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.579500:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.579867:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000402a2b37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659899712:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1776187968.579962:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.579971:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.579979:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000040:00080000:1.0:1776187968.580495:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].430, 64 off35776 00000004:00080000:1.0:1776187968.580503:0:12471:0:(osp_sync.c:1658:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 445564627383ns, next at 446564624825ns, rc = 0 00000040:00080000:1.0:1776187968.580523:0:12471:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4764, 184 off838056 00010000:00010000:1.0:1776187968.580634:0:12471:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580672:0:12471:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580684:0:12471:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580695:0:12471:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580701:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580707:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580769:0:12471:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:1.0:1776187968.580789:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002467f7d4 reply state 00000000d7f57bf5 transno 4294975141 ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.580800:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.580811:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.580818:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000017234a62 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.580821:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.580828:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.580842:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1eb:0x0].0x0 (00000000a45e680a) 00010000:00010000:3.0:1776187968.580845:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187968.580848:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.580853:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000017234a62/0x92b1eb87ee43a3d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634304179390912 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.580862:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.580863:0:12471:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a3c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.580864:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.580865:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.580870:0:12471:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a3c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580900:0:12471:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a3c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580905:0:12471:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000787789d5 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.580908:0:12471:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a3c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580913:0:12471:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a3c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580927:0:12471:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000001c12b283) 00010000:00010000:1.0:1776187968.580929:0:12471:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187968.580931:0:12471:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a3c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.580936:0:12471:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a3c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1776187968.580947:0:12471:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000002467f7d4 reply state 00000000d7f57bf5 transno 4294975141 ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.581030:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002467f7d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+40:11406:x1862467653422784:12345-192.168.204.20@tcp:36:rm.0 Request processed in 2509us (4586us total) trans 4294975141 rc 0/0 00000100:00100000:1.0:1776187968.581039:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15438 00000100:00100000:0.0:1776187968.581110:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000acae3e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659902080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.581159:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187968.581180:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1776187968.581191:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ae3186e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659902016:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187968.581549:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.581568:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.581615:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.581723:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.581748:0:6329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000025fca930 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6329:1862467659900864:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.581773:0:6329:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 3/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.581793:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1776187968.581802:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b584ae0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659902144:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1776187968.581814:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422848 00000100:00100000:0.0:1776187968.581835:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1776187968.581843:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000090b816d5/0x92b1eb87ee41e30e lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c79 expref: 63 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.581871:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422912 00010000:00010000:0.0:1776187968.581915:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee438173 lrc: 5/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca5ee expref: 64 pid: 6326 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.581935:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423040 00000100:00100000:1.0:1776187968.581940:0:11794:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd1918da pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:11794:1862467659900992:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.581947:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee436ec6 lrc: 5/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9ff1 expref: 65 pid: 10783 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.581953:0:11794:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 3/0,1 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.581966:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4341 00000100:00100000:0.0:1776187968.581972:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008739b0da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+65:2222:x1862467653422848:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.581987:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.581992:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000090b816d5/0x92b1eb87ee41e30e lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c79 expref: 65 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.581996:0:11819:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007929426f pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:11819:1862467659901056:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.582012:0:11819:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 3/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.582012:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000090b816d5/0x92b1eb87ee41e30e lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c79 expref: 65 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.582049:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4342 00010000:00010000:0.0:1776187968.582051:0:11842:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090b816d5/0x92b1eb87ee41e30e lrc: 0/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c79 expref: 65 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.582058:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000267f7899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+65:2225:x1862467653422912:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1776187968.582071:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.582075:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.582077:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee438173 lrc: 4/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca5ee expref: 64 pid: 6326 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.582079:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.582083:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.582090:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee438173 lrc: 3/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca5ee expref: 64 pid: 6326 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.582097:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 4/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.582118:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.582149:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008739b0da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+64:2222:x1862467653422848:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 176us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.582157:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4341 00000100:00100000:0.0:1776187968.582187:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4343 00000100:00100000:0.0:1776187968.582192:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000138d96d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+63:2222:x1862467653423040:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.582199:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.582203:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee436ec6 lrc: 5/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9ff1 expref: 63 pid: 10783 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.582212:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee436ec6 lrc: 4/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9ff1 expref: 63 pid: 10783 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.582224:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.582226:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.582228:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 3/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.582234:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 4/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.582246:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.582263:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000138d96d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+63:2222:x1862467653423040:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 70us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.582270:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4343 00010000:00010000:3.0:1776187968.582288:0:6329:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.582298:0:6329:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.582298:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659901952 00010000:00010000:3.0:1776187968.582309:0:6329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.582316:0:6329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.582322:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659902080 00010000:00010000:3.0:1776187968.582336:0:6329:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187968.582632:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653422976 00010000:00010000:2.0:1776187968.582650:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073e95615/0x92b1eb87ee41e8c5 lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ebe expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.582676:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4344 00000100:00100000:2.0:1776187968.582681:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030183490 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+59:2225:x1862467653422976:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00010000:00010000:2.0:1776187968.582690:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.582694:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073e95615/0x92b1eb87ee41e8c5 lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ebe expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.582702:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073e95615/0x92b1eb87ee41e8c5 lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ebe expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.582718:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073e95615/0x92b1eb87ee41e8c5 lrc: 0/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ebe expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.582729:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.582731:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.582733:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.582742:0:6329:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df83f436 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:2995:x1862467659900224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18337us (20912us total) trans 4294968183 rc 0/0 00010000:00010000:2.0:1776187968.582743:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 4/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.582756:0:6329:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2811 00010000:00010000:2.0:1776187968.582772:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.582777:0:6329:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659902144 00000100:00100000:2.0:1776187968.582796:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030183490 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+58:2225:x1862467653422976:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 114us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.582803:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4344 00010000:00010000:1.0:1776187968.582940:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee438173 lrc: 0/0,0 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca5ee expref: 62 pid: 6326 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.582949:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.582951:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.582952:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 3/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.582959:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 4/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583028:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.583049:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000267f7899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+61:2225:x1862467653422912:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 994us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.583056:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4342 00010000:00010000:1.0:1776187968.583101:0:11819:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583108:0:11819:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583115:0:11819:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583126:0:11819:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583139:0:11819:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1776187968.583473:0:11819:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d81b363c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+25:2994:x1862467659900480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18628us (20866us total) trans 4294968147 rc 0/0 00000100:00100000:1.0:1776187968.583482:0:11819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2813 00000100:00100000:1.0:1776187968.583498:0:11819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2823 00000100:00100000:1.0:1776187968.583502:0:11819:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f732f2c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+23:2993:x1862467659901952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.583524:0:11819:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:254 count 1 00010000:00010000:1.0:1776187968.583548:0:11819:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 3/0,1 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583574:0:11819:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ebed038f/0x92b1eb87ee41eb18 lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fc1 expref: 60 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583582:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.583583:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.583585:0:11819:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 4/0,1 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583610:0:11819:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ebed038f/0x92b1eb87ee41eb18 lrc: 3/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fc1 expref: 60 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583620:0:11819:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ebed038f/0x92b1eb87ee41eb18 lrc: 4/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fc1 expref: 60 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.583636:0:11819:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007929426f pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:11819:1862467659902208:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.583671:0:11819:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026fd70c8 going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.583688:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1776187968.583692:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583700:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002adbeaf3 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.583703:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583710:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583722:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 1/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583728:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a370 lrc: 0/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583744:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.583746:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583751:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000550d135e already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.583753:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583763:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583770:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 1/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583775:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a37e lrc: 0/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583786:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.583787:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.583788:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.583813:0:11797:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ea1a11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:11797:1862467659901184:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.583831:0:11797:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 3/0,1 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.583981:0:11790:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee436ec6 lrc: 0/0,0 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9ff1 expref: 60 pid: 10783 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.583991:0:11790:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008fd1dad5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659901120:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.584003:0:11790:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 3/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584010:0:11790:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 3/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584020:0:11790:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 3/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584026:0:11790:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 3/0,1 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584032:0:11790:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 2/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584047:0:11790:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.584394:0:11790:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f465fce1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:2994:x1862467659900096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19426us (21760us total) trans 4294968184 rc 0/0 00000100:00100000:1.0:1776187968.584402:0:11790:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2814 00000100:00100000:1.0:1776187968.584421:0:11790:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2824 00000100:00100000:1.0:1776187968.584426:0:11790:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005a6d022f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:2995:x1862467659902080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.584441:0:11790:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:284 count 1 00010000:00010000:1.0:1776187968.584454:0:11790:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 3/0,1 mode: --/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584465:0:11790:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008fb92cf4/0x92b1eb87ee420504 lrc: 2/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a6b expref: 59 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584471:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.584472:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.584474:0:11790:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 4/0,1 mode: --/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584498:0:11790:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008fb92cf4/0x92b1eb87ee420504 lrc: 3/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a6b expref: 59 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584507:0:11790:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008fb92cf4/0x92b1eb87ee420504 lrc: 4/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a6b expref: 59 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.584518:0:11790:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ea1a11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659902272:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.584546:0:11790:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ae9f50cc going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.584560:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.584564:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 2/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584570:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f73ddd4f already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.584572:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 2/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584578:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 3/0,0 mode: PW/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584590:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 1/0,0 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584595:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a385 lrc: 0/0,0 mode: --/PW res: [0x1a2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.584608:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.584610:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.584611:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1776187968.584638:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000280e0900/2, rc 0, transno 888 00000100:00100000:1.0:1776187968.584653:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000280e0900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659900096:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1776187968.584669:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000d41c77b6/2, rc 0, transno 851 00000100:00100000:1.0:1776187968.584677:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d41c77b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659900480:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.584992:0:11826:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a4e5517 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:11826:1862467659901248:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.585005:0:11794:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 3/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.585011:0:11826:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 3/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.585015:0:11794:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 3/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.585032:0:11794:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 3/0,1 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.585039:0:11794:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.585049:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016b67d7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659902400:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1776187968.585058:0:11794:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.585091:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187968.585490:0:11794:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088bac792 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:2994:x1862467659900160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20773us (22952us total) trans 4294968185 rc 0/0 00000100:00100000:2.0:1776187968.585498:0:11794:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2812 00000004:00080000:0.0:1776187968.585765:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000060cbfe30/2, rc 0, transno 889 00000100:00100000:0.0:1776187968.585780:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000060cbfe30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659900160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.585796:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187968.585803:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036df82dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659902336:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.585827:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187968.585946:0:11794:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659902400 00000100:00100000:0.0:1776187968.585955:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1776187968.585966:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d0975cc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659902464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187968.585968:0:11794:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659902336 00000100:00100000:2.0:1776187968.585981:0:11794:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2825 00000100:00100000:2.0:1776187968.585986:0:11794:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083a94df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:2995:x1862467659902144:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.585998:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1776187968.586005:0:11794:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:273 count 1 00000100:00100000:0.0:1776187968.586023:0:11818:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659902464 00010000:00010000:2.0:1776187968.586026:0:11794:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 3/0,1 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.586040:0:11794:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b0e4afb/0x92b1eb87ee41fd1d lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2707 expref: 57 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.586047:0:11818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2826 00010000:00010000:2.0:1776187968.586048:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.586051:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.586054:0:11794:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 4/0,1 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.586054:0:11818:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0a54e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+25:2994:x1862467659902400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.586075:0:11818:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:263 count 1 00010000:00010000:2.0:1776187968.586083:0:11794:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b0e4afb/0x92b1eb87ee41fd1d lrc: 3/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2707 expref: 57 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.586090:0:11818:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 3/0,1 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.586103:0:11818:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aae3b113/0x92b1eb87ee41f4aa lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2387 expref: 57 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.586115:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.586116:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.586117:0:11818:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 4/0,1 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.586137:0:11818:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aae3b113/0x92b1eb87ee41f4aa lrc: 3/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2387 expref: 57 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.586211:0:11825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2827 00000100:00100000:1.0:1776187968.586215:0:11825:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000344f6d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+25:2994:x1862467659902336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.586225:0:11825:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:257 count 1 00010000:00010000:1.0:1776187968.586237:0:11825:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 3/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.586246:0:11825:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4ec7237/0x92b1eb87ee41ed64 lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20bd expref: 59 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.586251:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.586252:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.586253:0:11825:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 4/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.586269:0:11825:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e4ec7237/0x92b1eb87ee41ed64 lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20bd expref: 59 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.586307:0:6329:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2828 00000100:00100000:3.0:1776187968.586311:0:6329:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ee3389a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:2996:x1862467659902464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1776187968.586320:0:6329:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:253 count 1 00010000:00010000:3.0:1776187968.586331:0:6329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 3/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.586340:0:6329:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c2155c1/0x92b1eb87ee41ea54 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f6d expref: 59 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.586344:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.586345:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.586346:0:6329:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 4/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.586360:0:6329:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c2155c1/0x92b1eb87ee41ea54 lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f6d expref: 59 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.586381:0:11794:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b0e4afb/0x92b1eb87ee41fd1d lrc: 4/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2707 expref: 57 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.586393:0:11794:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13701d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:11794:1862467659902528:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.586431:0:11794:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bf3baaf3 going to sleep for 43 seconds 00000100:00100000:2.0:1776187968.586953:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.587038:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187968.587094:0:11818:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aae3b113/0x92b1eb87ee41f4aa lrc: 4/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2387 expref: 57 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.587108:0:11818:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd82bb7e pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:11818:1862467659902592:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.587144:0:11818:0:(client.c:2500:ptlrpc_set_wait()) set 000000000abc0a8a going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.587176:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423104 00010000:00010000:0.0:1776187968.587198:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a0dca7c/0x92b1eb87ee41e62c lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1da6 expref: 58 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.587223:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423232 00010000:00010000:0.0:1776187968.587233:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa79097e/0x92b1eb87ee41f9ea lrc: 4/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25a9 expref: 59 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.587245:0:11825:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e4ec7237/0x92b1eb87ee41ed64 lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20bd expref: 59 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.587257:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4345 00000100:00100000:1.0:1776187968.587260:0:11825:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd1918da pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:11825:1862467659902656:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.587266:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b294ced pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+59:2222:x1862467653423104:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.587278:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.587283:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a0dca7c/0x92b1eb87ee41e62c lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1da6 expref: 59 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.587298:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a0dca7c/0x92b1eb87ee41e62c lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1da6 expref: 59 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.587312:0:6329:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c2155c1/0x92b1eb87ee41ea54 lrc: 4/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f6d expref: 59 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.587322:0:11842:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a0dca7c/0x92b1eb87ee41e62c lrc: 0/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1da6 expref: 59 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.587326:0:6329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fe5c9b61 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6329:1862467659902720:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.587355:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.587357:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.587360:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.587367:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 4/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.587401:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.587406:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.587427:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b294ced pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+58:2222:x1862467653423104:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 162us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.587445:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.587467:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.587543:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.587587:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.587634:0:11827:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d65b5018 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:11827:1862467659901888:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.587655:0:11827:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 3/0,1 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.587676:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423360 00010000:00010000:2.0:1776187968.587692:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c12ffce5/0x92b1eb87ee41f885 lrc: 5/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c250f expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.587707:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423488 00010000:00010000:2.0:1776187968.587715:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000096ab87b5/0x92b1eb87ee41e251 lrc: 5/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c2c expref: 60 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.587724:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423424 00010000:00010000:2.0:1776187968.587732:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000adfc180f/0x92b1eb87ee41ff8c lrc: 5/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c280a expref: 60 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.587741:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423168 00010000:00010000:2.0:1776187968.587748:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000623703fc/0x92b1eb87ee41e3d2 lrc: 5/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ccd expref: 61 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.587760:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4346 00000100:00100000:2.0:1776187968.587767:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031017d0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+60:2225:x1862467653423232:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00000100:00100000:0.0:1776187968.587769:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4345 00010000:00010000:2.0:1776187968.587779:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.587783:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa79097e/0x92b1eb87ee41f9ea lrc: 4/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25a9 expref: 60 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.587795:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa79097e/0x92b1eb87ee41f9ea lrc: 3/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25a9 expref: 59 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.587798:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4347 00000100:00100000:0.0:1776187968.587808:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065e2c7cc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+59:2224:x1862467653423360:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1776187968.587821:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.587826:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c12ffce5/0x92b1eb87ee41f885 lrc: 5/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c250f expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.587835:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c12ffce5/0x92b1eb87ee41f885 lrc: 4/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c250f expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.587854:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.587855:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.587857:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.587863:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 4/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.587894:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.587922:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065e2c7cc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+59:2224:x1862467653423360:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 116us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.587928:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4347 00000100:00100000:0.0:1776187968.587942:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4348 00000100:00100000:0.0:1776187968.587945:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cc2639a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+61:2224:x1862467653423488:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1776187968.587952:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.587956:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000096ab87b5/0x92b1eb87ee41e251 lrc: 5/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c2c expref: 61 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.587963:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000096ab87b5/0x92b1eb87ee41e251 lrc: 4/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c2c expref: 61 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.587976:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.587977:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.587979:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.587985:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 4/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.587997:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.588016:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cc2639a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+61:2224:x1862467653423488:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 68us (571us total) trans 0 rc 0/0 00010000:00010000:2.0:1776187968.588021:0:11830:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa79097e/0x92b1eb87ee41f9ea lrc: 0/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25a9 expref: 58 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.588027:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4348 00010000:00010000:2.0:1776187968.588039:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.588042:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.588044:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.588044:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4349 00000100:00100000:0.0:1776187968.588052:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071940cea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+57:2224:x1862467653423424:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.588058:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 4/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.588063:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.588069:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000adfc180f/0x92b1eb87ee41ff8c lrc: 5/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c280a expref: 57 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.588078:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000adfc180f/0x92b1eb87ee41ff8c lrc: 4/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c280a expref: 57 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.588081:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.588094:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.588095:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.588097:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.588102:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 4/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.588113:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.588130:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071940cea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+57:2224:x1862467653423424:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 81us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.588136:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4349 00000100:00100000:0.0:1776187968.588150:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4350 00000100:00100000:0.0:1776187968.588154:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000346b9b2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+60:2222:x1862467653423168:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.588174:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.588178:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000623703fc/0x92b1eb87ee41e3d2 lrc: 5/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ccd expref: 60 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.588187:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000623703fc/0x92b1eb87ee41e3d2 lrc: 4/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ccd expref: 60 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.588197:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031017d0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+56:2225:x1862467653423232:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 430us (1157us total) trans 0 rc 0/0 00010000:00010000:0.0:1776187968.588200:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.588202:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.588206:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.588209:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4346 00010000:00010000:0.0:1776187968.588217:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 4/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.588232:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.588253:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000346b9b2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+60:2222:x1862467653423168:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 98us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.588260:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4350 00000100:00100000:2.0:1776187968.588283:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.588306:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423552 00010000:00010000:0.0:1776187968.588322:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076b154d1/0x92b1eb87ee41fb72 lrc: 5/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2651 expref: 56 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.588342:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.588394:0:11825:0:(client.c:2500:ptlrpc_set_wait()) set 000000009e2d7a44 going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.588418:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.588423:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.588431:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e3273a0 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.588434:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 2/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.588442:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 3/0,0 mode: PW/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.588454:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 1/0,0 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.588460:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e3273a0/0x92b1eb87ee43a377 lrc: 0/0,0 mode: --/PW res: [0x1a8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.588475:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.588477:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.588478:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.588499:0:11796:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096ab87b5/0x92b1eb87ee41e251 lrc: 0/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c2c expref: 59 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.588507:0:11796:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d31b3e8a pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:11796:1862467659901696:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.588520:0:11796:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.588527:0:11796:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.588533:0:11796:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.588542:0:11796:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.588548:0:11796:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.588639:0:11796:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1776187968.588857:0:6329:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e8587547 going to sleep for 43 seconds 00010000:00010000:3.0:1776187968.588869:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.588897:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.588904:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025a9ff81 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.588906:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.588912:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 3/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.588924:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 1/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.588930:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025a9ff81/0x92b1eb87ee43a3af lrc: 0/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.588946:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.588948:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.588949:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.589538:0:11796:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007dcbae96 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:2993:x1862467659901504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19200us (19260us total) trans 4294968186 rc 0/0 00000100:00100000:1.0:1776187968.589548:0:11796:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2821 00010000:00010000:1.0:1776187968.589743:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187968.590975:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423616 00010000:00010000:3.0:1776187968.591011:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2b3a4f4/0x92b1eb87ee41f72e lrc: 4/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2475 expref: 57 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.591025:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4351 00000100:00100000:0.0:1776187968.591034:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008739b0da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+57:2225:x1862467653423552:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1776187968.591049:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.591056:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076b154d1/0x92b1eb87ee41fb72 lrc: 5/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2651 expref: 57 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.591074:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076b154d1/0x92b1eb87ee41fb72 lrc: 4/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2651 expref: 57 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.591101:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.591105:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.591108:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.591117:0:11824:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adfc180f/0x92b1eb87ee41ff8c lrc: 0/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c280a expref: 57 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.591118:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 4/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.591141:0:11824:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e42c13a pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:11824:1862467659901568:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.591151:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.591179:0:11824:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.591189:0:11824:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.591195:0:11824:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.591208:0:11824:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.591212:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008739b0da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+56:2225:x1862467653423552:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 176us (2928us total) trans 0 rc 0/0 00010000:00010000:1.0:1776187968.591224:0:11824:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.591249:0:11824:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.591747:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4351 00000100:00100000:3.0:1776187968.591765:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4352 00000100:00100000:3.0:1776187968.591772:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000138d96d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+55:2225:x1862467653423616:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1776187968.591783:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.591789:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2b3a4f4/0x92b1eb87ee41f72e lrc: 4/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2475 expref: 55 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.591800:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2b3a4f4/0x92b1eb87ee41f72e lrc: 3/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2475 expref: 55 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.591815:0:11830:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2b3a4f4/0x92b1eb87ee41f72e lrc: 0/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2475 expref: 55 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.591825:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.591827:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.591829:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.591835:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 4/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.591855:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.591890:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000138d96d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+54:2225:x1862467653423616:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 101us (3532us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.591898:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4352 00010000:00010000:3.0:1776187968.591917:0:11827:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.591924:0:11827:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.591930:0:11827:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.591939:0:11827:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.591950:0:11827:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1776187968.592406:0:11824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005359ef33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+26:2993:x1862467659901440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22346us (22416us total) trans 4294968148 rc 0/0 00000100:00100000:1.0:1776187968.592414:0:11824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2819 00010000:00010000:1.0:1776187968.592437:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1776187968.592442:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592454:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c460bc60 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.592458:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592466:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 3/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.592479:0:11826:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592481:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 1/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592502:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a3a8 lrc: 0/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.592502:0:11826:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.592525:0:11826:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.592533:0:11826:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592537:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.592541:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592555:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006b72ffb6 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.592558:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.592566:0:11826:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1776187968.592696:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 3/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592708:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 1/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592713:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a3bd lrc: 0/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592730:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.592733:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592739:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.592741:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592748:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592763:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 1/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592770:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a393 lrc: 0/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592787:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.592788:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.592791:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.592810:0:11797:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592816:0:11797:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592823:0:11797:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592828:0:11797:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.592842:0:11797:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1776187968.592994:0:11827:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000890f1430 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+26:2996:x1862467659901824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15303us (16076us total) trans 4294968149 rc 0/0 00000100:00100000:3.0:1776187968.593001:0:11827:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2822 00010000:00010000:3.0:1776187968.593030:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.593034:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.593041:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006aa2e88c already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.593043:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.593050:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 3/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.593064:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 1/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.593070:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006aa2e88c/0x92b1eb87ee43a38c lrc: 0/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.593086:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.593087:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.593089:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.593206:0:11797:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007eb3c018 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:2994:x1862467659900416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28180us (30554us total) trans 4294968150 rc 0/0 00000100:00100000:1.0:1776187968.593214:0:11797:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2815 00010000:00010000:1.0:1776187968.593239:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1776187968.593251:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000818d4c03/2, rc 0, transno 854 00010000:00010000:1.0:1776187968.593252:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593261:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593267:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.593270:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593276:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593287:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0xaaaf1035 (0000000077c38ae7) 00010000:00010000:1.0:1776187968.593290:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187968.593294:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593299:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a3cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ea:0x0].0xaaaf1035 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593312:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593318:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593323:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593332:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.593334:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593340:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593352:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1eb:0x0].0x0 (00000000a45e680a) 00010000:00010000:1.0:1776187968.593354:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1776187968.593356:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593361:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a3d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12471 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593403:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.593424:0:11792:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000623703fc/0x92b1eb87ee41e3d2 lrc: 0/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ccd expref: 58 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.593434:0:11792:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e059535c pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:11792:1862467659901312:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.593452:0:11792:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593458:0:11792:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593463:0:11792:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593469:0:11792:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 3/0,1 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.593474:0:11792:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.593492:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000818d4c03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659900416:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.593694:0:11792:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.594127:0:11792:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d74ae161 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:2995:x1862467659900928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28367us (29506us total) trans 4294968187 rc 0/0 00000100:00100000:1.0:1776187968.594135:0:11792:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2817 00010000:00010000:1.0:1776187968.594154:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.594158:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.594179:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9325880 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.594181:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 2/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.594188:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 3/0,0 mode: PW/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.594202:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 1/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.594209:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a39a lrc: 0/0,0 mode: --/PW res: [0xf6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.594227:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.594229:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.594230:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.594251:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423296 00000100:00100000:1.0:1776187968.594294:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15439 00000100:00100000:1.0:1776187968.594300:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2a12fe1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11414:x1862467653423296:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.594469:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2a12fe1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11414:x1862467653423296:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 168us (6882us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.594480:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15439 00000100:00100000:0.0:1776187968.594797:0:11826:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ba2a942 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+26:2995:x1862467659900352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29650us (30274us total) trans 4294968151 rc 0/0 00000100:00100000:0.0:1776187968.594818:0:11826:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2816 00010000:00010000:0.0:1776187968.594844:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.594862:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009157d9b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659902784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.594921:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1776187968.594960:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000e7b8745b/2, rc 0, transno 853 00000004:00080000:1.0:1776187968.594968:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000050e0db89/2, rc 0, transno 891 00000100:00100000:0.0:1776187968.594973:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7b8745b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659901824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.594983:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050e0db89 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659900928:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1776187968.594990:0:11829:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c12ffce5/0x92b1eb87ee41f885 lrc: 0/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c250f expref: 53 pid: 11816 timeout: 545 lvb_type: 0 00000004:00080000:1.0:1776187968.595000:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000617a485f/2, rc 0, transno 855 00000100:00100000:2.0:1776187968.595006:0:11829:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028e219af pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:11829:1862467659901376:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.595007:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000617a485f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659900352:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1776187968.595026:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000a6d51526/2, rc 0, transno 887 00010000:00010000:2.0:1776187968.595029:0:11829:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.595037:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6d51526 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659900224:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1776187968.595050:0:11829:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.595057:0:11829:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.595060:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005fa6ca06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659902976:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1776187968.595071:0:11829:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.595076:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a1507ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659903040:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1776187968.595079:0:11829:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.595096:0:11829:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.595100:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.595111:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000890d49e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659902912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.595142:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.595172:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659902784 00000100:00100000:0.0:1776187968.595179:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187968.595185:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c4ec120a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659902848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.595203:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659902976 00000100:00100000:0.0:1776187968.595209:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187968.596599:0:11829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008599647e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+28:2995:x1862467659900672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30733us (33262us total) trans 4294968152 rc 0/0 00000100:00100000:2.0:1776187968.596610:0:11829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2818 00000004:00080000:3.0:1776187968.597040:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000003ca7af7c/2, rc 0, transno 856 00000100:00100000:3.0:1776187968.597055:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003ca7af7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659900672:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.597339:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659902912 00000100:00100000:1.0:1776187968.597390:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659902848 00000100:00100000:1.0:1776187968.597413:0:11795:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2829 00000100:00100000:1.0:1776187968.597419:0:11795:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000927d9240 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:2996:x1862467659902784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.597450:0:11795:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:272 count 1 00010000:00010000:1.0:1776187968.597478:0:11795:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 3/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.597499:0:11795:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa6718b8/0x92b1eb87ee41fc36 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26a5 expref: 52 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.597504:0:11829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2830 00010000:00010000:1.0:1776187968.597511:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1776187968.597512:0:11829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e059535c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+28:2995:x1862467659902976:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.597514:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.597517:0:11795:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 4/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1776187968.597530:0:11829:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:245 count 1 00010000:00010000:2.0:1776187968.597546:0:11829:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 3/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.597555:0:11795:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa6718b8/0x92b1eb87ee41fc36 lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26a5 expref: 52 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.597561:0:11829:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dbaebd50/0x92b1eb87ee41e3b6 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1cb8 expref: 52 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.597569:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.597571:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.597573:0:11829:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 4/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.597591:0:11829:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dbaebd50/0x92b1eb87ee41e3b6 lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1cb8 expref: 52 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.597603:0:11829:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dbaebd50/0x92b1eb87ee41e3b6 lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1cb8 expref: 52 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.597617:0:11829:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030183490 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:11829:1862467659903168:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.597696:0:11829:0:(client.c:2500:ptlrpc_set_wait()) set 0000000073ba2d5c going to sleep for 43 seconds 00000100:00100000:2.0:1776187968.597721:0:11826:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2831 00000100:00100000:2.0:1776187968.597726:0:11826:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030d971c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+28:2994:x1862467659902912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1776187968.597741:0:11826:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:268 count 1 00010000:00010000:2.0:1776187968.597755:0:11826:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 3/0,1 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.597767:0:11826:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000375fd75e/0x92b1eb87ee41f949 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2563 expref: 52 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.597773:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.597775:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.597776:0:11826:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 4/0,1 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.597796:0:11826:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000375fd75e/0x92b1eb87ee41f949 lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2563 expref: 52 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.597957:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.597981:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.598001:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.598027:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.598050:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423744 00010000:00010000:3.0:1776187968.598080:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008fb92cf4/0x92b1eb87ee420504 lrc: 5/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a6b expref: 58 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.598109:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423872 00010000:00010000:3.0:1776187968.598123:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aae3b113/0x92b1eb87ee41f4aa lrc: 5/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2387 expref: 53 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.598141:0:11827:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2832 00000100:00100000:3.0:1776187968.598142:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423680 00000100:00100000:0.0:1776187968.598149:0:11827:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb87fcf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+26:2994:x1862467659902848:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1776187968.598155:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ebed038f/0x92b1eb87ee41eb18 lrc: 5/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fc1 expref: 59 pid: 11825 timeout: 545 lvb_type: 0 00002000:00080000:0.0:1776187968.598178:0:11827:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:255 count 1 00000100:00100000:3.0:1776187968.598180:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423808 00010000:00010000:3.0:1776187968.598193:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b0e4afb/0x92b1eb87ee41fd1d lrc: 5/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2707 expref: 54 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.598196:0:11827:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 3/0,1 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.598208:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4353 00010000:00010000:0.0:1776187968.598211:0:11827:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038030d0c/0x92b1eb87ee41ebdc lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2015 expref: 59 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.598218:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e08d0c88 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+59:2223:x1862467653423744:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.598232:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.598233:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.598234:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.598236:0:11827:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 4/0,1 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.598241:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008fb92cf4/0x92b1eb87ee420504 lrc: 5/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a6b expref: 59 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.598262:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008fb92cf4/0x92b1eb87ee420504 lrc: 4/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a6b expref: 59 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.598267:0:11827:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038030d0c/0x92b1eb87ee41ebdc lrc: 3/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2015 expref: 59 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.598279:0:11827:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038030d0c/0x92b1eb87ee41ebdc lrc: 4/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2015 expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.598290:0:11827:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007e46ee9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:11827:1862467659903296:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.598291:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.598294:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.598298:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 3/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.598308:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 4/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.598328:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.598352:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e08d0c88 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+59:2223:x1862467653423744:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 137us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.598359:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4353 00000100:00100000:3.0:1776187968.598379:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4354 00000100:00100000:3.0:1776187968.598383:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c59835b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+54:2223:x1862467653423872:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187968.598391:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.598395:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aae3b113/0x92b1eb87ee41f4aa lrc: 5/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2387 expref: 54 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.598402:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aae3b113/0x92b1eb87ee41f4aa lrc: 4/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2387 expref: 54 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.598418:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.598420:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.598422:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.598429:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 4/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.598440:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.598457:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c59835b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+54:2223:x1862467653423872:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 73us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.598462:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4354 00000100:00100000:3.0:1776187968.598505:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4355 00000100:00100000:3.0:1776187968.598509:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e144210c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+58:2223:x1862467653423680:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187968.598515:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.598518:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ebed038f/0x92b1eb87ee41eb18 lrc: 5/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fc1 expref: 58 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.598526:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ebed038f/0x92b1eb87ee41eb18 lrc: 4/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fc1 expref: 58 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.598535:0:11827:0:(client.c:2500:ptlrpc_set_wait()) set 000000007314a1a7 going to sleep for 43 seconds 00010000:00010000:3.0:1776187968.598537:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.598540:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.598542:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.598549:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 4/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.598560:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.598583:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e144210c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+58:2223:x1862467653423680:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 73us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.598589:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4355 00000100:00100000:0.0:1776187968.598607:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187968.598608:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4356 00000100:00100000:3.0:1776187968.598615:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e13c69aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+53:2223:x1862467653423808:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187968.598622:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.598626:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b0e4afb/0x92b1eb87ee41fd1d lrc: 5/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2707 expref: 53 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.598634:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b0e4afb/0x92b1eb87ee41fd1d lrc: 4/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2707 expref: 53 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.598648:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.598650:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.598652:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.598658:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 4/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.598662:0:11818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aae3b113/0x92b1eb87ee41f4aa lrc: 0/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2387 expref: 53 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.598673:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.598688:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e13c69aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+53:2223:x1862467653423808:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 73us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.598693:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4356 00000100:00100000:0.0:1776187968.598770:0:11818:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd82bb7e pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:11818:1862467659902592:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.598789:0:11818:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.598798:0:11818:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.598934:0:11818:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.598949:0:11818:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.598964:0:11818:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.598969:0:11795:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa6718b8/0x92b1eb87ee41fc36 lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26a5 expref: 51 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.598982:0:11795:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e42c13a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:11795:1862467659903104:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.598987:0:11818:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1776187968.599015:0:11795:0:(client.c:2500:ptlrpc_set_wait()) set 00000000eb311790 going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.599045:0:11790:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fb92cf4/0x92b1eb87ee420504 lrc: 0/0,0 mode: --/PW res: [0x11c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a6b expref: 57 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.599056:0:11790:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ea1a11 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659902272:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.599071:0:11790:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 3/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599078:0:11790:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 3/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599090:0:11790:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 3/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599098:0:11790:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 3/0,1 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599104:0:11790:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 2/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599119:0:11790:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1776187968.599284:0:11818:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0a54e30 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+29:2994:x1862467659902400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13230us (14194us total) trans 4294968153 rc 0/0 00000100:00100000:0.0:1776187968.599292:0:11818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2826 00000100:00100000:0.0:1776187968.599311:0:11818:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659903040 00000100:00100000:0.0:1776187968.599344:0:11818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2833 00010000:00010000:2.0:1776187968.599349:0:11826:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000375fd75e/0x92b1eb87ee41f949 lrc: 4/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2563 expref: 51 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.599349:0:11818:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000294394ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+27:2996:x1862467659903040:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187968.599360:0:11826:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000267f7899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:11826:1862467659903232:192.168.204.20@tcp:104: 00002000:00080000:0.0:1776187968.599365:0:11818:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:280 count 1 00010000:00010000:0.0:1776187968.599381:0:11818:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 3/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.599389:0:11826:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c87ea308 going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.599391:0:11818:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009426e946/0x92b1eb87ee4201f4 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c291b expref: 56 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.599397:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.599399:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.599401:0:11818:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 4/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.599414:0:6328:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076b154d1/0x92b1eb87ee41fb72 lrc: 0/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2651 expref: 51 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.599424:0:11818:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009426e946/0x92b1eb87ee4201f4 lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c291b expref: 56 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.599426:0:6328:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b84092ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6328:1862467659901760:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.599440:0:6328:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.599447:0:6328:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.599452:0:6328:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.599459:0:6328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.599464:0:6328:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.599474:0:6328:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1776187968.599591:0:11790:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005a6d022f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:2995:x1862467659902080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15163us (18432us total) trans 4294968188 rc 0/0 00000100:00100000:1.0:1776187968.599598:0:11790:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2824 00010000:00010000:1.0:1776187968.599621:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1776187968.599625:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599633:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000095ae11d5 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.599636:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599659:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 3/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599678:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 1/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599690:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095ae11d5/0x92b1eb87ee43a3a1 lrc: 0/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599713:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1776187968.599716:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599722:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000af78cd92 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.599724:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599730:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 3/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599739:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 1/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599745:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af78cd92/0x92b1eb87ee43a3f5 lrc: 0/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599766:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1776187968.599769:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 2/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599775:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.599779:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 2/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599803:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 3/0,0 mode: PW/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599814:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 1/0,0 mode: --/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599819:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a3e7 lrc: 0/0,0 mode: --/PW res: [0x11c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599836:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.599839:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599845:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ec1ebc7a already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.599846:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.599848:0:6328:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000783ba691 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:2995:x1862467659901632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29508us (29599us total) trans 4294968154 rc 0/0 00010000:00010000:1.0:1776187968.599858:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 3/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.599862:0:6328:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2820 00010000:00010000:1.0:1776187968.599902:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 1/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599908:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec1ebc7a/0x92b1eb87ee43a3b6 lrc: 0/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599922:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.599924:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.599925:0:11794:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b0e4afb/0x92b1eb87ee41fd1d lrc: 0/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2707 expref: 50 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.599926:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.599940:0:11794:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13701d1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:11794:1862467659902528:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.599957:0:11794:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.599964:0:11794:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.599969:0:11794:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.599975:0:11819:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ebed038f/0x92b1eb87ee41eb18 lrc: 0/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fc1 expref: 56 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.599978:0:11794:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.599978:0:11818:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009426e946/0x92b1eb87ee4201f4 lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c291b expref: 56 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.599995:0:11794:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.600003:0:11819:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007929426f pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:11819:1862467659902208:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.600003:0:11818:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f1ff9cf0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659903424:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.600009:0:11794:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1776187968.600023:0:11819:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.600032:0:11819:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.600035:0:11818:0:(client.c:2500:ptlrpc_set_wait()) set 000000005b8832ea going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.600040:0:11819:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.600048:0:11819:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.600053:0:11819:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600054:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.600060:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.600065:0:11819:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1776187968.600068:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089fb6120 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.600071:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600077:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 3/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600089:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 1/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600095:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a3ee lrc: 0/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600108:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.600110:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600120:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009615f87f already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.600122:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600128:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 3/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600137:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 1/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600142:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009615f87f/0x92b1eb87ee43a3e0 lrc: 0/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600153:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.600154:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.600155:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1776187968.600208:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000016b67d7f/2, rc 0, transno 857 00000100:00100000:0.0:1776187968.600221:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016b67d7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659902400:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.600228:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187968.600238:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a14ab09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659903360:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.600268:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.600343:0:11816:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659903360 00000100:00100000:0.0:1776187968.600373:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2834 00000100:00100000:0.0:1776187968.600378:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000249e47c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:2994:x1862467659903360:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1776187968.600392:0:11794:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083a94df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:2995:x1862467659902144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14405us (18558us total) trans 4294968155 rc 0/0 00002000:00080000:0.0:1776187968.600394:0:11816:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:244 count 1 00000100:00100000:2.0:1776187968.600399:0:11794:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2825 00010000:00010000:0.0:1776187968.600411:0:11816:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 3/0,1 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600424:0:11816:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003345bf70/0x92b1eb87ee41e2cf lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c64 expref: 49 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.600451:0:11819:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f732f2c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+28:2993:x1862467659901952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16947us (21744us total) trans 4294968189 rc 0/0 00000100:00100000:1.0:1776187968.600457:0:11819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2823 00010000:00010000:1.0:1776187968.600477:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1776187968.600495:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000b584ae0e/2, rc 0, transno 859 00000100:00100000:1.0:1776187968.600512:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b584ae0e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659902144:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1776187968.600525:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000acae3e30/2, rc 0, transno 892 00000100:00100000:1.0:1776187968.600534:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000acae3e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659902080:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1776187968.600543:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000f2203b2c/2, rc 0, transno 858 00000100:00100000:1.0:1776187968.600545:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2203b2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659901632:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.600594:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007929426f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659903552:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.600617:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1776187968.600636:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.600638:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.600640:0:11816:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 4/0,1 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.600644:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659903552 00000100:00100000:1.0:1776187968.600673:0:9338:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2835 00000100:00100000:1.0:1776187968.600678:0:9338:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093ea1a11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:2995:x1862467659903552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.600690:0:9338:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:258 count 1 00010000:00010000:1.0:1776187968.600702:0:9338:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 3/0,1 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.600715:0:9338:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b3350de/0x92b1eb87ee41ee28 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2111 expref: 55 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.600721:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.600723:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.600724:0:9338:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 4/0,1 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.600742:0:9338:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b3350de/0x92b1eb87ee41ee28 lrc: 3/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2111 expref: 55 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.600753:0:9338:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b3350de/0x92b1eb87ee41ee28 lrc: 4/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2111 expref: 55 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.600755:0:11816:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003345bf70/0x92b1eb87ee41e2cf lrc: 3/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c64 expref: 49 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.600780:0:11816:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003345bf70/0x92b1eb87ee41e2cf lrc: 4/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c64 expref: 49 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.600785:0:9338:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d31b3e8a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9338:1862467659903616:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.600793:0:11816:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ae5db700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:11816:1862467659903680:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.600815:0:9338:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026fd70c8 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.600960:0:11816:0:(client.c:2500:ptlrpc_set_wait()) set 000000000abc0a8a going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.600993:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005c5ca962 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659903488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.601019:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.601117:0:11824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659903488 00000100:00100000:0.0:1776187968.601141:0:11824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2836 00000100:00100000:0.0:1776187968.601145:0:11824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cfad8e60 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+30:2994:x1862467659903488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.601157:0:11824:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:274 count 1 00010000:00010000:0.0:1776187968.601180:0:11824:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 3/0,1 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.601191:0:11824:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be8d3ae7/0x92b1eb87ee41fde1 lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c275b expref: 49 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.601197:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.601198:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.601199:0:11824:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 4/0,1 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.601220:0:11824:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be8d3ae7/0x92b1eb87ee41fde1 lrc: 3/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c275b expref: 49 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.601227:0:11824:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be8d3ae7/0x92b1eb87ee41fde1 lrc: 4/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c275b expref: 49 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.601235:0:11824:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000012fd664c pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:11824:1862467659903744:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.601259:0:11824:0:(client.c:2500:ptlrpc_set_wait()) set 000000008c92170b going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.601301:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1776187968.601551:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000037e2dad/2, rc 0, transno 893 00000100:00100000:0.0:1776187968.601564:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000037e2dad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659901952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.601608:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000032853440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659903808:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.601635:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1776187968.602346:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.602647:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659902016 00000100:00100000:0.0:1776187968.602689:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659903808 00000100:00100000:0.0:1776187968.602708:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2837 00000100:00100000:0.0:1776187968.602713:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025c71879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:2993:x1862467659902016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.602734:0:6326:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:252 count 1 00010000:00010000:0.0:1776187968.602758:0:6326:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 3/0,1 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.602778:0:6326:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c59d570a/0x92b1eb87ee41e990 lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f19 expref: 55 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.602785:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.602786:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.602788:0:6326:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 4/0,1 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.602812:0:6326:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c59d570a/0x92b1eb87ee41e990 lrc: 3/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f19 expref: 55 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.602821:0:6326:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c59d570a/0x92b1eb87ee41e990 lrc: 4/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f19 expref: 55 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.602832:0:6326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db1b501c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6326:1862467659904000:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.603016:0:11792:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2838 00000100:00100000:2.0:1776187968.603022:0:11792:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000083801d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:2996:x1862467659903808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187968.603038:0:11792:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:256 count 1 00010000:00010000:2.0:1776187968.603051:0:11792:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 3/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603062:0:11792:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000104a43dd/0x92b1eb87ee41ec99 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2069 expref: 55 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603067:0:11792:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.603068:0:11792:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.603069:0:11792:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 4/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603086:0:11792:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000104a43dd/0x92b1eb87ee41ec99 lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2069 expref: 55 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603093:0:11792:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000104a43dd/0x92b1eb87ee41ec99 lrc: 4/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2069 expref: 55 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.603101:0:11792:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031017d0d pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:11792:1862467659904064:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.603227:0:11792:0:(client.c:2500:ptlrpc_set_wait()) set 00000000224b65d3 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.603332:0:6326:0:(client.c:2500:ptlrpc_set_wait()) set 000000008ab46b9c going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.603352:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b294ced pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659903936:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.603385:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.603449:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187968.603455:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13701d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659903872:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.603477:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187968.603547:0:11819:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659903936 00000100:00100000:2.0:1776187968.603574:0:11819:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659903872 00000100:00100000:2.0:1776187968.603589:0:11819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2839 00000100:00100000:2.0:1776187968.603592:0:11819:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b117547 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+32:2994:x1862467659903936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1776187968.603605:0:11819:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:243 count 1 00010000:00010000:2.0:1776187968.603619:0:11819:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 3/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603634:0:11819:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009b0149b1/0x92b1eb87ee41e20b lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c09 expref: 49 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603639:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.603641:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.603642:0:11819:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 4/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603659:0:11819:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009b0149b1/0x92b1eb87ee41e20b lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c09 expref: 49 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603666:0:11819:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009b0149b1/0x92b1eb87ee41e20b lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c09 expref: 49 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.603675:0:11819:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d65b5018 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:11819:1862467659904128:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.603698:0:11819:0:(client.c:2500:ptlrpc_set_wait()) set 000000004a0117dc going to sleep for 43 seconds 00000100:00100000:2.0:1776187968.603715:0:6328:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2840 00000100:00100000:2.0:1776187968.603719:0:6328:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000618c42d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:2994:x1862467659903872:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1776187968.603730:0:6328:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:275 count 1 00010000:00010000:2.0:1776187968.603740:0:6328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 3/0,1 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603750:0:6328:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ed7d210/0x92b1eb87ee41fec8 lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27b6 expref: 49 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603756:0:6328:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.603757:0:6328:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.603758:0:6328:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 4/0,1 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603774:0:6328:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ed7d210/0x92b1eb87ee41fec8 lrc: 3/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27b6 expref: 49 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.603782:0:6328:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ed7d210/0x92b1eb87ee41fec8 lrc: 4/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27b6 expref: 49 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.603790:0:6328:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b2a2aca pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6328:1862467659904192:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.603812:0:6328:0:(client.c:2500:ptlrpc_set_wait()) set 000000001fe29203 going to sleep for 43 seconds 00000004:00080000:0.0:1776187968.604430:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000000bf0cc0f/2, rc 0, transno 890 00000100:00100000:0.0:1776187968.604482:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000bf0cc0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659901504:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1776187968.604500:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000060a1c46b/2, rc 0, transno 852 00000100:00100000:0.0:1776187968.604510:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000060a1c46b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659901440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.604566:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1776187968.604577:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf261950 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659904256:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.604612:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.604637:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659904256 00000100:00100000:1.0:1776187968.604763:0:11796:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2841 00000100:00100000:1.0:1776187968.604768:0:11796:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd9a9483 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:2996:x1862467659904256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.604788:0:11796:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:255 count 1 00010000:00010000:1.0:1776187968.604805:0:11796:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 3/0,1 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.604821:0:11796:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009e7eb7f2/0x92b1eb87ee41eca0 lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2062 expref: 49 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.604827:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.604828:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.604830:0:11796:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 4/0,1 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.604851:0:11796:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009e7eb7f2/0x92b1eb87ee41eca0 lrc: 3/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2062 expref: 49 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.604859:0:11796:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009e7eb7f2/0x92b1eb87ee41eca0 lrc: 4/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2062 expref: 49 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.604868:0:11796:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041a08231 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:11796:1862467659904320:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.604943:0:11796:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ae9f50cc going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.604973:0:11825:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd1918da pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:11825:1862467659902656:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.604999:0:11825:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 3/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.605591:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d31787e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659904384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.605625:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187968.605779:0:10783:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659904384 00000100:00100000:2.0:1776187968.605819:0:10783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2842 00000100:00100000:2.0:1776187968.605824:0:10783:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad791b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:2996:x1862467659904384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187968.605841:0:10783:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:282 count 1 00010000:00010000:2.0:1776187968.605861:0:10783:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 3/0,1 mode: --/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.605899:0:10783:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049966c52/0x92b1eb87ee42037c lrc: 2/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29c3 expref: 55 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.605907:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.605909:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.605910:0:10783:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 4/0,1 mode: --/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.605934:0:10783:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049966c52/0x92b1eb87ee42037c lrc: 3/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29c3 expref: 55 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.605949:0:10783:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049966c52/0x92b1eb87ee42037c lrc: 4/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29c3 expref: 55 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.605960:0:10783:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d509fe pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10783:1862467659904448:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.605998:0:10783:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bcc2b55 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.607491:0:6329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fe5c9b61 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6329:1862467659902720:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.607518:0:6329:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 3/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.607601:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.607650:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.608234:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653423936 00010000:00010000:0.0:1776187968.608271:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e4ec7237/0x92b1eb87ee41ed64 lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20bd expref: 56 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.608309:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424000 00010000:00010000:0.0:1776187968.608319:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c2155c1/0x92b1eb87ee41ea54 lrc: 4/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f6d expref: 57 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.608378:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4357 00000100:00100000:0.0:1776187968.608384:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cc2639a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+57:2222:x1862467653423936:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.608398:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.608402:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e4ec7237/0x92b1eb87ee41ed64 lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20bd expref: 57 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.608412:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e4ec7237/0x92b1eb87ee41ed64 lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20bd expref: 57 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.608439:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4ec7237/0x92b1eb87ee41ed64 lrc: 0/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20bd expref: 57 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.608455:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.608458:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.608461:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.608470:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 4/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.608495:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.608539:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cc2639a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+56:2222:x1862467653423936:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 154us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.608546:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4357 00000100:00100000:0.0:1776187968.608573:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4358 00000100:00100000:0.0:1776187968.608578:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071940cea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+55:2223:x1862467653424000:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.608585:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.608588:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c2155c1/0x92b1eb87ee41ea54 lrc: 4/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f6d expref: 55 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.608596:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c2155c1/0x92b1eb87ee41ea54 lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f6d expref: 55 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.608610:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c2155c1/0x92b1eb87ee41ea54 lrc: 0/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f6d expref: 55 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.608625:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.608626:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.608628:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.608634:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 4/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.608651:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.608939:0:6329:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.608948:0:6329:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.608956:0:6329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.608962:0:6329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.608978:0:6329:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187968.609201:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.609206:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.609215:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000005bf1cdd already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.609218:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.609226:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.609241:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 1/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.609247:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a403 lrc: 0/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.609267:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.609269:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.609271:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.609456:0:6329:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ee3389a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:2996:x1862467659902464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23143us (23458us total) trans 4294968190 rc 0/0 00000100:00100000:0.0:1776187968.609465:0:6329:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2828 00010000:00010000:0.0:1776187968.609492:0:11825:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.609503:0:11825:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.609510:0:11825:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.609515:0:11825:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.609531:0:11825:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1776187968.609565:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000d0975cc8/2, rc 0, transno 894 00000100:00100000:2.0:1776187968.609578:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d0975cc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659902464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.610082:0:11825:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000344f6d72 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+32:2994:x1862467659902336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23865us (24253us total) trans 4294968191 rc 0/0 00000100:00100000:0.0:1776187968.610089:0:11825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2827 00010000:00010000:0.0:1776187968.610109:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.610112:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.610119:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cffdb7a9 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.610122:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.610128:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.610141:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 1/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.610152:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cffdb7a9/0x92b1eb87ee43a3fc lrc: 0/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.610177:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.610179:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.610180:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1776187968.610205:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000036df82dd/2, rc 0, transno 895 00000100:00100000:0.0:1776187968.610222:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036df82dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659902336:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.610228:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187968.610239:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000346b9b2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659904512:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.610274:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.610301:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659904512 00000100:00100000:0.0:1776187968.610329:0:11825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2843 00000100:00100000:0.0:1776187968.610334:0:11825:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078272e20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+32:2994:x1862467659904512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.610358:0:11825:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:263 count 1 00010000:00010000:0.0:1776187968.610379:0:11825:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 3/0,1 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.610394:0:11825:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049fa4eb1/0x92b1eb87ee41f3f4 lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2341 expref: 54 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.610401:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.610403:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.610404:0:11825:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 4/0,1 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.610428:0:11825:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049fa4eb1/0x92b1eb87ee41f3f4 lrc: 3/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2341 expref: 54 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.610439:0:11825:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049fa4eb1/0x92b1eb87ee41f3f4 lrc: 4/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2341 expref: 54 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.610448:0:11825:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f0afe19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:11825:1862467659904576:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.610493:0:11825:0:(client.c:2500:ptlrpc_set_wait()) set 00000000edb08996 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.610519:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071940cea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+54:2223:x1862467653424000:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 1939us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.610528:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4358 00000100:00100000:0.0:1776187968.610557:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1776187968.610594:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008739b0da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659904640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.610620:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187968.610661:0:6329:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659904640 00000100:00100000:2.0:1776187968.611497:0:6329:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2844 00000100:00100000:2.0:1776187968.611504:0:6329:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f6a1304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:2993:x1862467659904640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187968.611523:0:6329:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:278 count 1 00010000:00010000:2.0:1776187968.611547:0:6329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 3/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.611562:0:6329:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d853d13a/0x92b1eb87ee42006c lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2873 expref: 53 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.611569:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.611570:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.611572:0:6329:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 4/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.611594:0:6329:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d853d13a/0x92b1eb87ee42006c lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2873 expref: 53 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.611605:0:6329:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d853d13a/0x92b1eb87ee42006c lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2873 expref: 53 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.611615:0:6329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000138d96d2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6329:1862467659904704:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.611661:0:6329:0:(client.c:2500:ptlrpc_set_wait()) set 00000000e8587547 going to sleep for 43 seconds 00000100:00100000:2.0:1776187968.617001:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.617363:0:11827:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007e46ee9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:11827:1862467659903296:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.617391:0:11827:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 3/0,1 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.617510:0:11829:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030183490 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:11829:1862467659903168:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.617529:0:11829:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 3/0,1 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.618515:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424064 00000100:00100000:0.0:1776187968.618648:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15440 00000100:00100000:0.0:1776187968.618655:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c57b803b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11414:x1862467653424064:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187968.618959:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c57b803b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11414:x1862467653424064:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 303us (1969us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.618969:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15440 00000100:00100000:0.0:1776187968.633469:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.633506:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.633671:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.633689:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.633731:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.633758:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.633776:0:11796:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041a08231 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:11796:1862467659904320:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.633777:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.633793:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.633807:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1776187968.633809:0:11796:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 3/0,1 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.633822:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.633839:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.633851:0:9338:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d31b3e8a pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9338:1862467659903616:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.633858:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1776187968.633869:0:9338:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 3/0,1 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.633893:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.633922:0:11795:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e42c13a pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:11795:1862467659903104:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.633931:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:1.0:1776187968.633938:0:11795:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 3/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.633952:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.633982:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424192 00010000:00010000:1.0:1776187968.634017:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038030d0c/0x92b1eb87ee41ebdc lrc: 4/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2015 expref: 54 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.634044:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424128 00000100:00100000:0.0:1776187968.634044:0:11818:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f1ff9cf0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659903424:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.634057:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dbaebd50/0x92b1eb87ee41e3b6 lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1cb8 expref: 50 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634060:0:11818:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 3/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.634090:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424320 00000100:00100000:0.0:1776187968.634096:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424448 00010000:00010000:1.0:1776187968.634101:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000104a43dd/0x92b1eb87ee41ec99 lrc: 5/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2069 expref: 56 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634113:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c59d570a/0x92b1eb87ee41e990 lrc: 5/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f19 expref: 56 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.634115:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424576 00010000:00010000:1.0:1776187968.634129:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ed7d210/0x92b1eb87ee41fec8 lrc: 5/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27b6 expref: 51 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.634135:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424704 00000100:00100000:1.0:1776187968.634146:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424832 00010000:00010000:0.0:1776187968.634150:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009e7eb7f2/0x92b1eb87ee41eca0 lrc: 4/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2062 expref: 52 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.634170:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b3350de/0x92b1eb87ee41ee28 lrc: 4/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2111 expref: 57 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.634178:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424256 00000100:00100000:1.0:1776187968.634188:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424384 00010000:00010000:0.0:1776187968.634194:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be8d3ae7/0x92b1eb87ee41fde1 lrc: 5/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c275b expref: 54 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.634201:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa6718b8/0x92b1eb87ee41fc36 lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26a5 expref: 54 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.634212:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424512 00000100:00100000:1.0:1776187968.634220:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424640 00010000:00010000:0.0:1776187968.634226:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009b0149b1/0x92b1eb87ee41e20b lrc: 5/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c09 expref: 56 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.634233:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000375fd75e/0x92b1eb87ee41f949 lrc: 5/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2563 expref: 56 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.634244:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424768 00000100:00100000:1.0:1776187968.634251:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424896 00010000:00010000:0.0:1776187968.634260:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009426e946/0x92b1eb87ee4201f4 lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c291b expref: 58 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.634266:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003345bf70/0x92b1eb87ee41e2cf lrc: 5/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c64 expref: 57 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.634280:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653424960 00000100:00100000:1.0:1776187968.634290:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4359 00010000:00010000:0.0:1776187968.634293:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049966c52/0x92b1eb87ee42037c lrc: 5/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29c3 expref: 59 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.634301:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007b68c7c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+59:2224:x1862467653424192:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00000100:00100000:0.0:1776187968.634315:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4360 00010000:00010000:1.0:1776187968.634319:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1776187968.634322:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e46ee9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+57:2224:x1862467653424128:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1776187968.634328:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038030d0c/0x92b1eb87ee41ebdc lrc: 4/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2015 expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634332:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.634338:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dbaebd50/0x92b1eb87ee41e3b6 lrc: 4/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1cb8 expref: 57 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.634339:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038030d0c/0x92b1eb87ee41ebdc lrc: 3/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2015 expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634360:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dbaebd50/0x92b1eb87ee41e3b6 lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1cb8 expref: 57 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.634375:0:5502:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038030d0c/0x92b1eb87ee41ebdc lrc: 0/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2015 expref: 59 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634380:0:11842:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dbaebd50/0x92b1eb87ee41e3b6 lrc: 0/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1cb8 expref: 57 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.634395:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.634396:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.634398:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.634399:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.634404:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.634404:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.634425:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 4/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.634425:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 4/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.634463:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.634464:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.634482:0:11827:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.634490:0:11827:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.634500:0:11827:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.634507:0:11827:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.634512:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e46ee9f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+56:2224:x1862467653424128:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 188us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.634526:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4360 00010000:00010000:1.0:1776187968.634539:0:11827:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.634546:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4361 00000100:00100000:0.0:1776187968.634551:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb29a7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+58:2224:x1862467653424320:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.634559:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.634563:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000104a43dd/0x92b1eb87ee41ec99 lrc: 5/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2069 expref: 58 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634573:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000104a43dd/0x92b1eb87ee41ec99 lrc: 4/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2069 expref: 58 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634589:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.634591:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.634593:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.634600:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 4/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.634613:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.634632:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb29a7c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+58:2224:x1862467653424320:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 80us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.634638:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4361 00000100:00100000:0.0:1776187968.634651:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4362 00000100:00100000:0.0:1776187968.634655:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd82bb7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+57:2224:x1862467653424448:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.634662:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.634665:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c59d570a/0x92b1eb87ee41e990 lrc: 5/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f19 expref: 57 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634673:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c59d570a/0x92b1eb87ee41e990 lrc: 4/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f19 expref: 57 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634694:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.634696:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.634698:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.634705:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 4/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.634718:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.634734:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd82bb7e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+57:2224:x1862467653424448:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 78us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.634741:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4362 00000100:00100000:0.0:1776187968.634756:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4363 00000100:00100000:0.0:1776187968.634760:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000946cec49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+55:2224:x1862467653424576:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.634767:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.634771:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ed7d210/0x92b1eb87ee41fec8 lrc: 5/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27b6 expref: 55 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634780:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ed7d210/0x92b1eb87ee41fec8 lrc: 4/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27b6 expref: 55 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634794:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.634796:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.634799:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.634806:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 4/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.634819:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.634838:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000946cec49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+55:2224:x1862467653424576:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 77us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.634846:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4363 00000100:00100000:0.0:1776187968.634865:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4364 00000100:00100000:0.0:1776187968.634869:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b9316eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+54:2224:x1862467653424704:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.634906:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.634911:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009e7eb7f2/0x92b1eb87ee41eca0 lrc: 4/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2062 expref: 54 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.634916:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4365 00010000:00010000:0.0:1776187968.634927:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009e7eb7f2/0x92b1eb87ee41eca0 lrc: 3/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2062 expref: 54 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.634928:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000092e338f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+56:2224:x1862467653424832:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187968.634943:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.634948:0:11842:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e7eb7f2/0x92b1eb87ee41eca0 lrc: 0/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2062 expref: 54 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.634950:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b3350de/0x92b1eb87ee41ee28 lrc: 4/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2111 expref: 56 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634970:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.634971:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b3350de/0x92b1eb87ee41ee28 lrc: 3/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2111 expref: 56 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.634974:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.634977:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.634987:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 4/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.634992:0:11830:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b3350de/0x92b1eb87ee41ee28 lrc: 0/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2111 expref: 56 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.635009:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.635030:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b9316eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+53:2224:x1862467653424704:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 158us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.635037:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4364 00000100:00100000:0.0:1776187968.635053:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4366 00000100:00100000:0.0:1776187968.635058:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085fc26ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+52:2224:x1862467653424256:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187968.635065:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.635070:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be8d3ae7/0x92b1eb87ee41fde1 lrc: 5/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c275b expref: 52 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.635077:0:11827:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb87fcf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+34:2994:x1862467659902848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36924us (39865us total) trans 4294968192 rc 0/0 00010000:00010000:0.0:1776187968.635086:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be8d3ae7/0x92b1eb87ee41fde1 lrc: 4/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c275b expref: 52 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.635094:0:11827:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2832 00010000:00010000:3.0:1776187968.635096:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.635099:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.635102:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.635110:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.635111:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 4/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.635113:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.635116:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.635125:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 4/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.635135:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.635138:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.635140:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.635141:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.635150:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005ac9bdea already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.635154:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.635173:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 3/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.635180:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000092e338f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+55:2224:x1862467653424832:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 252us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.635190:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4365 00010000:00010000:1.0:1776187968.635190:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 1/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.635198:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ac9bdea/0x92b1eb87ee43a41f lrc: 0/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.635210:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4367 00010000:00010000:1.0:1776187968.635216:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187968.635217:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cd66b6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+52:2224:x1862467653424384:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1776187968.635219:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.635221:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.635227:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.635231:0:9338:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.635232:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa6718b8/0x92b1eb87ee41fc36 lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26a5 expref: 52 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.635255:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa6718b8/0x92b1eb87ee41fc36 lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26a5 expref: 52 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.635256:0:9338:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.635274:0:9338:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.635279:0:9338:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.635295:0:9338:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187968.635330:0:11826:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000267f7899 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:11826:1862467659903232:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.635350:0:11826:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 3/0,1 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.635358:0:11830:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa6718b8/0x92b1eb87ee41fc36 lrc: 0/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26a5 expref: 52 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.635372:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.635375:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.635377:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.635383:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 4/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.635386:0:11819:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d65b5018 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:11819:1862467659904128:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.635404:0:11819:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 3/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.635411:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.635434:0:6328:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ed7d210/0x92b1eb87ee41fec8 lrc: 0/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27b6 expref: 51 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.635452:0:6328:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b2a2aca pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6328:1862467659904192:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.635461:0:6328:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.635468:0:6328:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.635473:0:6328:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.635480:0:6328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.635486:0:6328:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.635500:0:6328:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1776187968.637040:0:9338:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093ea1a11 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:2995:x1862467659903552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36356us (36417us total) trans 4294968193 rc 0/0 00000100:00100000:0.0:1776187968.637051:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085fc26ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+50:2224:x1862467653424256:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 1989us (3256us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.637057:0:9338:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2835 00000100:00100000:0.0:1776187968.637064:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4366 00000100:00100000:0.0:1776187968.637092:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4368 00010000:00010000:1.0:1776187968.637096:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1776187968.637103:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043c2e2f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+49:2224:x1862467653424512:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1776187968.637104:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.637105:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cd66b6b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+49:2224:x1862467653424384:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 1882us (3292us total) trans 0 rc 0/0 00010000:00010000:0.0:1776187968.637121:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1776187968.637122:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4367 00010000:00010000:1.0:1776187968.637123:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.637128:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637131:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009b0149b1/0x92b1eb87ee41e20b lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c09 expref: 49 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.637148:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 3/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637153:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009b0149b1/0x92b1eb87ee41e20b lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c09 expref: 48 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.637170:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4369 00000100:00100000:3.0:1776187968.637179:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5641d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+48:2224:x1862467653424640:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1776187968.637185:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 1/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.637190:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.637191:0:11842:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b0149b1/0x92b1eb87ee41e20b lrc: 0/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c09 expref: 48 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.637198:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000375fd75e/0x92b1eb87ee41f949 lrc: 4/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2563 expref: 48 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.637217:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a434 lrc: 0/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.637236:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000375fd75e/0x92b1eb87ee41f949 lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2563 expref: 47 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.637241:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.637244:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.637248:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.637249:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.637252:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.637256:0:11830:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000375fd75e/0x92b1eb87ee41f949 lrc: 0/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2563 expref: 47 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.637267:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 4/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.637275:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a27740b3 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.637279:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.637291:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 3/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.637293:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.637296:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.637300:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637302:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.637306:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 1/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.637308:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 4/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.637324:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a457 lrc: 0/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.637325:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043c2e2f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+46:2224:x1862467653424512:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 223us (3499us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.637340:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4368 00010000:00010000:3.0:1776187968.637350:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.637350:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.637354:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.637357:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187968.637382:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5641d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+45:2224:x1862467653424640:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 203us (3543us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.637390:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4370 00000004:00080000:1.0:1776187968.637398:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000007929426f/2, rc 0, transno 897 00000100:00100000:3.0:1776187968.637401:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4369 00000100:00100000:0.0:1776187968.637406:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007658a4ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+54:2224:x1862467653424768:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00000100:00100000:2.0:1776187968.637410:0:6328:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000618c42d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:2994:x1862467659903872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33687us (33930us total) trans 4294968156 rc 0/0 00000100:00100000:1.0:1776187968.637416:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007929426f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659903552:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.637418:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1776187968.637424:0:6328:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2840 00000100:00100000:3.0:1776187968.637425:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4371 00010000:00010000:0.0:1776187968.637428:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009426e946/0x92b1eb87ee4201f4 lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c291b expref: 54 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.637436:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000048466f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+44:2224:x1862467653424896:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187968.637449:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.637449:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009426e946/0x92b1eb87ee4201f4 lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c291b expref: 54 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.637457:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003345bf70/0x92b1eb87ee41e2cf lrc: 5/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c64 expref: 44 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.637459:0:11826:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637470:0:11842:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009426e946/0x92b1eb87ee4201f4 lrc: 0/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c291b expref: 54 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.637476:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003345bf70/0x92b1eb87ee41e2cf lrc: 4/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c64 expref: 44 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.637477:0:11826:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.637493:0:11826:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637493:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1776187968.637495:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1776187968.637496:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.637500:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.637511:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e42c13a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659904768:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1776187968.637514:0:11826:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637522:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 4/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.637535:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.637538:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.637540:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.637548:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 4/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.637548:0:11826:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.637557:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1776187968.637558:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187968.637572:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.637580:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007658a4ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+53:2224:x1862467653424768:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 182us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.637589:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4370 00000100:00100000:3.0:1776187968.637595:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000048466f2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+44:2224:x1862467653424896:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 160us (3720us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.637602:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4371 00010000:00010000:1.0:1776187968.637607:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.637612:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.637619:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4372 00010000:00010000:1.0:1776187968.637627:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025e5acf1 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.637631:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.637631:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000303dd311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+52:2224:x1862467653424960:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:1.0:1776187968.637640:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637654:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.637657:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 1/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637660:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049966c52/0x92b1eb87ee42037c lrc: 5/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29c3 expref: 52 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.637671:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049966c52/0x92b1eb87ee42037c lrc: 4/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29c3 expref: 52 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.637685:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a418 lrc: 0/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637693:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.637695:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.637696:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 3/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637701:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 4/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637708:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.637717:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000303dd311 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+52:2224:x1862467653424960:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 91us (3790us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.637721:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4372 00010000:00010000:0.0:1776187968.637734:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.637739:0:11818:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637744:0:11818:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637748:0:11818:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637751:0:11818:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.637767:0:11818:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187968.638240:0:11826:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030d971c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+34:2994:x1862467659902912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40512us (43099us total) trans 4294968157 rc 0/0 00000100:00100000:2.0:1776187968.638248:0:11826:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2831 00000100:00100000:2.0:1776187968.638265:0:11826:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659904768 00000100:00100000:2.0:1776187968.638290:0:11826:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2845 00000100:00100000:2.0:1776187968.638294:0:11826:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d31b3e8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+35:2996:x1862467659904768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187968.638314:0:11826:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:262 count 1 00010000:00010000:2.0:1776187968.638333:0:11826:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 3/0,1 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638346:0:11826:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000013fdac8c/0x92b1eb87ee41f2f8 lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22df expref: 51 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638358:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.638360:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.638361:0:11826:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 4/0,1 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638385:0:11826:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000013fdac8c/0x92b1eb87ee41f2f8 lrc: 3/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22df expref: 51 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638396:0:11826:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000013fdac8c/0x92b1eb87ee41f2f8 lrc: 4/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22df expref: 51 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.638406:0:11826:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b2a2aca pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:11826:1862467659904832:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.638435:0:11826:0:(client.c:2500:ptlrpc_set_wait()) set 000000001fe29203 going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.638438:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.638442:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.638449:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000862e8a84 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.638451:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.638456:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.638469:0:6329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000138d96d2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6329:1862467659904704:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.638474:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 1/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.638481:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000862e8a84/0x92b1eb87ee43a426 lrc: 0/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638489:0:6329:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 3/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.638493:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.638494:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.638496:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.638523:0:11796:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638528:0:11824:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be8d3ae7/0x92b1eb87ee41fde1 lrc: 0/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c275b expref: 43 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.638538:0:11796:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.638546:0:11824:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000012fd664c pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:11824:1862467659903744:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.638548:0:11796:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 3/0,1 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.638558:0:11796:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638560:0:11824:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638572:0:11824:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638578:0:11824:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.638579:0:11796:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187968.638589:0:11824:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638594:0:11824:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638610:0:11824:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1776187968.638722:0:11818:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000294394ae pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+35:2996:x1862467659903040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 39372us (40119us total) trans 4294968194 rc 0/0 00000100:00100000:0.0:1776187968.638732:0:11818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2833 00010000:00010000:0.0:1776187968.638754:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1776187968.638758:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638766:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c460bc60 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.638768:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 2/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638776:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 3/0,0 mode: PW/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.638780:0:11824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cfad8e60 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+34:2994:x1862467659903488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37631us (37758us total) trans 4294968158 rc 0/0 00000100:00100000:2.0:1776187968.638791:0:11824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2836 00010000:00010000:0.0:1776187968.638809:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 1/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638816:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c460bc60/0x92b1eb87ee43a45e lrc: 0/0,0 mode: --/PW res: [0xff:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638828:0:11792:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000104a43dd/0x92b1eb87ee41ec99 lrc: 0/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2069 expref: 51 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.638831:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.638835:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.638843:0:11792:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031017d0d pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:11792:1862467659904064:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.638843:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f73ddd4f already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.638845:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638854:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 3/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638859:0:11792:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638868:0:11792:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638895:0:11792:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638899:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 1/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638916:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a43b lrc: 0/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638919:0:11792:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.638930:0:11792:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638934:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.638937:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.638938:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.638941:0:11792:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1776187968.638942:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.638946:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638952:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.638954:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638960:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638969:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 1/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638975:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a449 lrc: 0/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.638987:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.638989:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.638990:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.639004:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425024 00000100:00100000:0.0:1776187968.639058:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15441 00000100:00100000:0.0:1776187968.639064:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006a3043d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11414:x1862467653425024:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187968.639247:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a3043d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11414:x1862467653425024:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 181us (5295us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.639256:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15441 00010000:00010000:0.0:1776187968.639284:0:11819:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639293:0:11819:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639300:0:11819:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639305:0:11819:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639320:0:11819:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187968.639373:0:11792:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000083801d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:2996:x1862467659903808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36349us (37737us total) trans 4294968195 rc 0/0 00000100:00100000:2.0:1776187968.639380:0:11792:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2838 00010000:00010000:2.0:1776187968.639423:0:10783:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049966c52/0x92b1eb87ee42037c lrc: 0/0,0 mode: --/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29c3 expref: 50 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.639437:0:10783:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d509fe pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10783:1862467659904448:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.639456:0:10783:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 3/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.639463:0:10783:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 3/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.639470:0:10783:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 3/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.639478:0:10783:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 3/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.639490:0:10783:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 2/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.639496:0:11796:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd9a9483 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:2996:x1862467659904256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 34723us (34882us total) trans 4294968159 rc 0/0 00010000:00010000:2.0:1776187968.639503:0:10783:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1776187968.639507:0:11796:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2841 00000100:00100000:0.0:1776187968.639537:0:11819:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b117547 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+34:2994:x1862467659903936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35942us (36151us total) trans 4294968160 rc 0/0 00000100:00100000:0.0:1776187968.639550:0:11819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2839 00000004:00080000:1.0:1776187968.639574:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000bf261950/2, rc 0, transno 863 00010000:00010000:0.0:1776187968.639575:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1776187968.639582:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.639593:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf261950 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659904256:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.639594:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8111509 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.639599:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639607:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1776187968.639610:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000032853440/2, rc 0, transno 899 00010000:00010000:0.0:1776187968.639621:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 1/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.639623:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000032853440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659903808:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.639634:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a450 lrc: 0/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1776187968.639641:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000001a1507ae/2, rc 0, transno 898 00000100:00100000:1.0:1776187968.639647:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a1507ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659903040:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.639653:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.639656:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 2/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639663:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.639666:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 2/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639671:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 3/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639680:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 1/0,0 mode: --/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639691:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e544251/0x92b1eb87ee43a465 lrc: 0/0,0 mode: --/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639705:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.639707:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.639709:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.639723:0:11829:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639731:0:11829:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639739:0:11829:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 3/0,1 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639745:0:11829:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.639759:0:11829:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187968.639910:0:10783:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad791b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+35:2996:x1862467659904384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34084us (34284us total) trans 4294968196 rc 0/0 00000100:00100000:2.0:1776187968.639918:0:10783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2842 00000100:00100000:1.0:1776187968.639966:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000041a08231 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659904896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1776187968.639984:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.640077:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1776187968.640112:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000d31787e1/2, rc 0, transno 900 00000100:00100000:2.0:1776187968.640120:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.640122:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d31787e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659904384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.640150:0:11829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e059535c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+34:2995:x1862467659902976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 42638us (45053us total) trans 4294968161 rc 0/0 00000100:00100000:0.0:1776187968.640173:0:11829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2830 00000100:00100000:0.0:1776187968.640191:0:11829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659904896 00000100:00100000:0.0:1776187968.640213:0:11829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2846 00000100:00100000:0.0:1776187968.640217:0:11829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025fca930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+34:2996:x1862467659904896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.640233:0:11829:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:240 count 1 00010000:00010000:0.0:1776187968.640255:0:11829:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 3/0,1 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640272:0:11829:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000614c3b95/0x92b1eb87ee41dea0 lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ab9 expref: 42 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640280:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.640282:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.640284:0:11829:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 4/0,1 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.640296:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1776187968.640306:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000030fe3c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659905088:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.640312:0:11829:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000614c3b95/0x92b1eb87ee41dea0 lrc: 3/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ab9 expref: 42 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640324:0:11829:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000614c3b95/0x92b1eb87ee41dea0 lrc: 4/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ab9 expref: 42 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.640338:0:11829:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000946cec49 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:11829:1862467659905152:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.640340:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1776187968.640368:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1776187968.640372:0:11829:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f8b224a7 going to sleep for 6 seconds 00010000:00010000:1.0:1776187968.640373:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.640382:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092776876 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.640385:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 2/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640387:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.640391:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 3/0,0 mode: PW/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.640405:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 1/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640410:0:11816:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003345bf70/0x92b1eb87ee41e2cf lrc: 0/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1c64 expref: 42 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.640416:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092776876/0x92b1eb87ee43a411 lrc: 0/0,0 mode: --/PW res: [0xf5:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.640428:0:11816:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ae5db700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:11816:1862467659903680:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.640440:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.640443:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.640445:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.640447:0:11816:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640456:0:11816:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640463:0:11816:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1776187968.640468:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000005fa6ca06/2, rc 0, transno 865 00010000:00010000:0.0:1776187968.640471:0:11816:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 3/0,1 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.640479:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005fa6ca06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659902976:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.640479:0:11816:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640500:0:11816:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.640527:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ddc6d453 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659905216:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.640557:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.640595:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659905088 00000100:00100000:1.0:1776187968.640624:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659905216 00000100:00100000:1.0:1776187968.640645:0:11796:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2847 00000100:00100000:1.0:1776187968.640649:0:11796:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca963743 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:2996:x1862467659905088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.640662:0:11796:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:281 count 1 00000100:00100000:0.0:1776187968.640666:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000249e47c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:2994:x1862467659903360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40286us (40397us total) trans 4294968162 rc 0/0 00000100:00100000:0.0:1776187968.640674:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2834 00000100:00100000:0.0:1776187968.640690:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2848 00000100:00100000:0.0:1776187968.640694:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c1aac22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:2996:x1862467659905216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.640705:0:11816:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:241 count 1 00010000:00010000:0.0:1776187968.640716:0:11816:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 3/0,1 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640727:0:11816:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdfb02c3/0x92b1eb87ee41df9c lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b1b expref: 41 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640733:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.640735:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.640736:0:11816:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 4/0,1 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640757:0:11816:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdfb02c3/0x92b1eb87ee41df9c lrc: 3/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b1b expref: 41 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640764:0:11816:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdfb02c3/0x92b1eb87ee41df9c lrc: 4/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b1b expref: 41 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.640772:0:11816:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006b9316eb pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:11816:1862467659905280:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.640789:0:11816:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a8f3b4af going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.640799:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.640801:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640807:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.640809:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 2/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640814:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 3/0,0 mode: PW/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640825:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 1/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640831:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a42d lrc: 0/0,0 mode: --/PW res: [0xf4:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640843:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.640845:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.640847:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.640855:0:11796:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 3/0,1 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.640865:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425152 00010000:00010000:1.0:1776187968.640868:0:11796:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000012daf3f1/0x92b1eb87ee4202b8 lrc: 2/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c296f expref: 49 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.640901:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.640902:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.640904:0:11796:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 4/0,1 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.640911:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d853d13a/0x92b1eb87ee42006c lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2873 expref: 50 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.640930:0:11796:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000012daf3f1/0x92b1eb87ee4202b8 lrc: 3/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c296f expref: 50 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.640938:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425088 00010000:00010000:1.0:1776187968.640941:0:11796:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000012daf3f1/0x92b1eb87ee4202b8 lrc: 4/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c296f expref: 50 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.640952:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049fa4eb1/0x92b1eb87ee41f3f4 lrc: 5/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2341 expref: 51 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.640954:0:11796:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028e219af pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:11796:1862467659905344:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.640973:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4373 00000100:00100000:0.0:1776187968.640977:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095d509fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+51:2224:x1862467653425152:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1776187968.640987:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.640991:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d853d13a/0x92b1eb87ee42006c lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2873 expref: 51 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.641000:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d853d13a/0x92b1eb87ee42006c lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2873 expref: 51 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.641014:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d853d13a/0x92b1eb87ee42006c lrc: 0/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2873 expref: 51 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.641025:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.641026:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.641029:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.641036:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 4/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.641062:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.641067:0:11796:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ae9f50cc going to sleep for 6 seconds 00000100:00100000:0.0:1776187968.641081:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095d509fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+50:2224:x1862467653425152:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 102us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.641089:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4373 00010000:00010000:1.0:1776187968.641098:0:11795:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.641107:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4374 00010000:00010000:1.0:1776187968.641108:0:11795:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.641117:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031017d0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+49:2224:x1862467653425088:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1776187968.641122:0:11795:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.641127:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.641132:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.641132:0:11795:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.641133:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049fa4eb1/0x92b1eb87ee41f3f4 lrc: 5/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2341 expref: 49 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.641156:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049fa4eb1/0x92b1eb87ee41f3f4 lrc: 4/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2341 expref: 49 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.641176:0:11795:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1776187968.641182:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.641185:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.641187:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.641194:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 4/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.641209:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.641225:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031017d0d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+49:2224:x1862467653425088:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 110us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.641232:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4374 00000100:00100000:0.0:1776187968.641260:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000050642aa4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659905024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.641295:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1776187968.641328:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000a13701d1/2, rc 0, transno 860 00000100:00100000:0.0:1776187968.641339:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13701d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659903872:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1776187968.641352:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000002b294ced/2, rc 0, transno 864 00000100:00100000:0.0:1776187968.641355:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b294ced pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659903936:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1776187968.641363:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000005c5ca962/2, rc 0, transno 862 00000100:00100000:0.0:1776187968.641365:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005c5ca962 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659903488:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1776187968.641371:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000009a14ab09/2, rc 0, transno 866 00000100:00100000:0.0:1776187968.641374:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a14ab09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659903360:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1776187968.641387:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000c4ec120a/2, rc 0, transno 896 00000100:00100000:0.0:1776187968.641397:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c4ec120a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659902848:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1776187968.641409:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000890d49e1/2, rc 0, transno 861 00000100:00100000:0.0:1776187968.641411:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000890d49e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659902912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.641423:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187968.641428:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd1918da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659904960:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.641455:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.641521:0:11795:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000927d9240 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:2996:x1862467659902784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44101us (46600us total) trans 4294968163 rc 0/0 00000100:00100000:1.0:1776187968.641530:0:11795:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2829 00000100:00100000:1.0:1776187968.641550:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659905024 00000100:00100000:0.0:1776187968.641579:0:11819:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659904960 00000100:00100000:1.0:1776187968.641583:0:11795:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2849 00000100:00100000:1.0:1776187968.641588:0:11795:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000092e338f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:2994:x1862467659905024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.641602:0:11795:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:279 count 1 00000100:00100000:0.0:1776187968.641605:0:11819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2850 00000100:00100000:0.0:1776187968.641610:0:11819:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085fc26ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+37:2994:x1862467659904960:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1776187968.641616:0:11795:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 3/0,1 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1776187968.641623:0:11819:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:283 count 1 00010000:00010000:1.0:1776187968.641632:0:11795:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000513a57e/0x92b1eb87ee420130 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28c7 expref: 48 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.641638:0:11819:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 3/0,1 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.641640:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.641642:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.641643:0:11795:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 4/0,1 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.641661:0:11795:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000513a57e/0x92b1eb87ee420130 lrc: 3/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28c7 expref: 48 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.641857:0:11795:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000513a57e/0x92b1eb87ee420130 lrc: 4/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28c7 expref: 48 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.641867:0:11795:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a4e5517 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:11795:1862467659905792:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.641908:0:11795:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026fd70c8 going to sleep for 6 seconds 00000100:00100000:1.0:1776187968.641924:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002e053a51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659905600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.641948:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1776187968.642030:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000009157d9b5/2, rc 0, transno 867 00000100:00100000:1.0:1776187968.642041:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009157d9b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659902784:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.642050:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1776187968.642054:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000827745c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659905536:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.642077:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.642127:0:11827:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659905600 00000100:00100000:1.0:1776187968.642147:0:11827:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659905536 00000100:00100000:1.0:1776187968.642174:0:11827:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2851 00000100:00100000:1.0:1776187968.642178:0:11827:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008fd1dad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+37:2996:x1862467659905600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.642191:0:11827:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:281 count 1 00010000:00010000:1.0:1776187968.642204:0:11827:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 3/0,1 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642214:0:11827:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095fda5b1/0x92b1eb87ee420375 lrc: 2/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29bc expref: 41 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642220:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.642221:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.642222:0:11827:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 4/0,1 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642241:0:11827:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095fda5b1/0x92b1eb87ee420375 lrc: 3/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29bc expref: 41 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642250:0:11827:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095fda5b1/0x92b1eb87ee420375 lrc: 4/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29bc expref: 41 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.642274:0:11827:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a10603c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:11827:1862467659905920:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.642274:0:11819:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078884edb/0x92b1eb87ee420440 lrc: 2/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a17 expref: 48 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.642289:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.642291:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.642293:0:11819:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 4/0,1 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.642296:0:11827:0:(client.c:2500:ptlrpc_set_wait()) set 000000000abc0a8a going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.642315:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1776187968.642315:0:11819:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078884edb/0x92b1eb87ee420440 lrc: 3/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a17 expref: 48 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.642323:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d1f0f2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659905856:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.642327:0:11819:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078884edb/0x92b1eb87ee420440 lrc: 4/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a17 expref: 48 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.642339:0:11819:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000035f62d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:11819:1862467659905984:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.642352:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.642366:0:11819:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a473366e going to sleep for 6 seconds 00000100:00100000:0.0:1776187968.642387:0:11790:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659905856 00000100:00100000:1.0:1776187968.642400:0:9338:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2852 00000100:00100000:1.0:1776187968.642406:0:9338:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000416f053d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:2996:x1862467659905536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.642419:0:9338:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:254 count 1 00000100:00100000:0.0:1776187968.642422:0:11790:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2853 00000100:00100000:0.0:1776187968.642428:0:11790:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000894dc1df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:2996:x1862467659905856:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.642433:0:9338:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 3/0,1 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1776187968.642442:0:11790:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:256 count 1 00010000:00010000:1.0:1776187968.642446:0:9338:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f83f7e1/0x92b1eb87ee41eb9d lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ff9 expref: 41 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642454:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.642456:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.642457:0:11790:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 3/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642458:0:9338:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 4/0,1 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.642480:0:11790:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f1b2480/0x92b1eb87ee41ed56 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20af expref: 41 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.642487:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.642489:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.642491:0:11790:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 4/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642494:0:9338:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f83f7e1/0x92b1eb87ee41eb9d lrc: 3/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ff9 expref: 41 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642512:0:9338:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f83f7e1/0x92b1eb87ee41eb9d lrc: 4/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ff9 expref: 41 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.642520:0:9338:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000843473e1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9338:1862467659906048:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.642534:0:11790:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f1b2480/0x92b1eb87ee41ed56 lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20af expref: 41 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.642537:0:9338:0:(client.c:2500:ptlrpc_set_wait()) set 000000008c92170b going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.642546:0:11790:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f1b2480/0x92b1eb87ee41ed56 lrc: 4/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20af expref: 41 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.642557:0:11790:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000013546a3c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:11790:1862467659906112:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.642574:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007b68c7c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+48:2224:x1862467653424192:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 8275us (9112us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.642581:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4359 00000100:00100000:0.0:1776187968.642583:0:11790:0:(client.c:2500:ptlrpc_set_wait()) set 000000005871094c going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.642611:0:6329:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.642620:0:6329:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.642626:0:6329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.642633:0:6329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.642770:0:6329:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1776187968.642823:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1776187968.642828:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642837:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.642840:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642848:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642868:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 1/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642898:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a40a lrc: 0/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642919:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.642922:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642928:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aea18492 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.642930:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642937:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642947:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 1/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.642953:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aea18492/0x92b1eb87ee43a473 lrc: 0/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.643008:0:6329:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f6a1304 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:2993:x1862467659904640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 31504us (32387us total) trans 4294968197 rc 0/0 00000100:00100000:0.0:1776187968.643016:0:6329:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2844 00010000:00010000:1.0:1776187968.643033:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.643035:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.643038:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.643251:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f43bbdf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659905472:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.643281:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.643301:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000071fa85c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659905728:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.643322:0:11797:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659905472 00000100:00100000:0.0:1776187968.643328:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.643349:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1776187968.643355:0:11797:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659905728 00000100:00100000:0.0:1776187968.643357:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002cd66b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659905408:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.643375:0:11797:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2854 00000100:00100000:1.0:1776187968.643380:0:11797:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008256682a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:2994:x1862467659905472:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.643386:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1776187968.643400:0:11797:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:282 count 1 00000100:00100000:0.0:1776187968.643404:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000001ee6948 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659905664:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.643417:0:11797:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 3/0,1 mode: --/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.643428:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1776187968.643430:0:11797:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a76d044/0x92b1eb87ee420432 lrc: 2/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a09 expref: 41 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.643438:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.643440:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.643442:0:11797:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 4/0,1 mode: --/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.643456:0:11818:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659905408 00010000:00010000:1.0:1776187968.643464:0:11797:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a76d044/0x92b1eb87ee420432 lrc: 3/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a09 expref: 41 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.643475:0:11797:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a76d044/0x92b1eb87ee420432 lrc: 4/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a09 expref: 41 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.643480:0:11818:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659905664 00000100:00100000:1.0:1776187968.643486:0:11797:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006afce0ba pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:11797:1862467659906176:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.643499:0:11818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2855 00000100:00100000:0.0:1776187968.643504:0:11818:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7a98837 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+38:2994:x1862467659905728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.643518:0:11818:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:417 count 1 00000100:00100000:1.0:1776187968.643523:0:11797:0:(client.c:2500:ptlrpc_set_wait()) set 000000007314a1a7 going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.643531:0:11818:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 3/0,1 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.643544:0:11794:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2856 00010000:00010000:0.0:1776187968.643546:0:11818:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d515954/0x92b1eb87ee436b9a lrc: 2/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9f0a expref: 47 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.643552:0:11794:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6f393cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:2994:x1862467659905408:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.643558:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.643561:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.643562:0:11818:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 4/0,1 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1776187968.643570:0:11794:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:257 count 1 00010000:00010000:0.0:1776187968.643581:0:11818:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d515954/0x92b1eb87ee436b9a lrc: 3/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9f0a expref: 47 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.643584:0:11794:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 3/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.643594:0:11818:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d515954/0x92b1eb87ee436b9a lrc: 4/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9f0a expref: 47 pid: 11829 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.643619:0:11818:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cdf55e6c pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659906240:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.643622:0:11794:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4dfe39f/0x92b1eb87ee41ee1a lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2103 expref: 41 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.643631:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.643633:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.643634:0:11794:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 4/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.643657:0:11794:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4dfe39f/0x92b1eb87ee41ee1a lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2103 expref: 41 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.643849:0:11794:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4dfe39f/0x92b1eb87ee41ee1a lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2103 expref: 41 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.643859:0:11794:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000077c3b583 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:11794:1862467659906304:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.644048:0:11818:0:(client.c:2500:ptlrpc_set_wait()) set 000000008546d52d going to sleep for 6 seconds 00010000:00010000:0.0:1776187968.644081:0:11825:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049fa4eb1/0x92b1eb87ee41f3f4 lrc: 0/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2341 expref: 47 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.644092:0:11794:0:(client.c:2500:ptlrpc_set_wait()) set 000000009e2d7a44 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.644095:0:11825:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f0afe19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:11825:1862467659904576:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.644116:0:11825:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.644126:0:11825:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.644131:0:11824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2857 00010000:00010000:0.0:1776187968.644137:0:11825:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.644139:0:11824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db84b536 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+41:2994:x1862467659905664:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.644152:0:11825:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 3/0,1 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1776187968.644156:0:11824:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:251 count 1 00010000:00010000:0.0:1776187968.644168:0:11825:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.644183:0:11824:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 3/0,1 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.644187:0:11825:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1776187968.644198:0:11824:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000069146745/0x92b1eb87ee41e966 lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f04 expref: 41 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.644205:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.644207:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.644208:0:11824:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 4/0,1 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.644226:0:11824:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000069146745/0x92b1eb87ee41e966 lrc: 3/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f04 expref: 41 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.644233:0:11824:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000069146745/0x92b1eb87ee41e966 lrc: 4/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f04 expref: 41 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.644241:0:11824:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006439688d pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:11824:1862467659906368:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.644263:0:11824:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c87ea308 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.645020:0:11825:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078272e20 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+39:2994:x1862467659904512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34683us (34745us total) trans 4294968198 rc 0/0 00000100:00100000:0.0:1776187968.645028:0:11825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2843 00000004:00080000:1.0:1776187968.645136:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000346b9b2f/2, rc 0, transno 902 00000100:00100000:1.0:1776187968.645153:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000346b9b2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659904512:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.645154:0:6326:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c59d570a/0x92b1eb87ee41e990 lrc: 0/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f19 expref: 46 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.645182:0:6326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db1b501c pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6326:1862467659904000:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.645200:0:6326:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.645224:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1776187968.645236:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d3eeab83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659906432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.645273:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1776187968.645308:0:6326:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.645317:0:6326:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.645324:0:6326:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.645332:0:6326:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.645355:0:6326:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1776187968.645399:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1776187968.645405:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.645414:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000059fd37 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.645417:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 2/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.645425:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 3/0,0 mode: PW/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.645449:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 1/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.645455:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000059fd37/0x92b1eb87ee43a46c lrc: 0/0,0 mode: --/PW res: [0x107:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.645476:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.645478:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.645485:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001a2405b6 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.645487:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.645493:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 3/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.645504:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 1/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.645511:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a2405b6/0x92b1eb87ee43a442 lrc: 0/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.645512:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025c71879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:2993:x1862467659902016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 42796us (44208us total) trans 4294968199 rc 0/0 00000100:00100000:0.0:1776187968.645528:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2837 00010000:00010000:1.0:1776187968.645537:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.645540:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.645541:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.645629:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659906432 00000100:00100000:0.0:1776187968.645759:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2858 00000100:00100000:0.0:1776187968.645764:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052710b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:2995:x1862467659906432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.645782:0:6326:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:265 count 1 00010000:00010000:0.0:1776187968.645798:0:6326:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 3/0,1 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.645809:0:6326:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000af687307/0x92b1eb87ee41f640 lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2421 expref: 45 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.645816:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.645818:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.645819:0:6326:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 4/0,1 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.645841:0:6326:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000af687307/0x92b1eb87ee41f640 lrc: 3/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2421 expref: 45 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.645850:0:6326:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000af687307/0x92b1eb87ee41f640 lrc: 4/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2421 expref: 45 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.645861:0:6326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000098599a18 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6326:1862467659906496:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.645919:0:6326:0:(client.c:2500:ptlrpc_set_wait()) set 00000000994de56e going to sleep for 6 seconds 00000004:00080000:0.0:1776187968.645984:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000008739b0da/2, rc 0, transno 901 00000100:00100000:0.0:1776187968.645994:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008739b0da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659904640:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1776187968.646032:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000004ae3186e/2, rc 0, transno 903 00000100:00100000:0.0:1776187968.646039:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ae3186e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659902016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.646068:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b2fcc41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659906560:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.646073:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000be51259f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659906624:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.646096:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.646116:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.646378:0:11792:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659906560 00000100:00100000:0.0:1776187968.646402:0:11792:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659906624 00000100:00100000:0.0:1776187968.646418:0:11792:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2859 00000100:00100000:0.0:1776187968.646422:0:11792:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070dcc367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:2993:x1862467659906560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.646434:0:11792:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:423 count 1 00010000:00010000:0.0:1776187968.646447:0:11792:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 3/0,1 mode: --/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.646457:0:11792:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee437ebe lrc: 2/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca51c expref: 45 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.646463:0:11792:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.646464:0:11792:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.646466:0:11792:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 4/0,1 mode: --/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.646484:0:11792:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee437ebe lrc: 3/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca51c expref: 45 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.646493:0:11792:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee437ebe lrc: 4/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca51c expref: 45 pid: 11792 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.646502:0:11792:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d74ae161 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:11792:1862467659906688:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.646531:0:11792:0:(client.c:2500:ptlrpc_set_wait()) set 000000009e8ae2a0 going to sleep for 6 seconds 00000100:00100000:0.0:1776187968.646546:0:6329:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2860 00000100:00100000:0.0:1776187968.646550:0:6329:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f42d7af2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:2994:x1862467659906624:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.646562:0:6329:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:247 count 1 00010000:00010000:0.0:1776187968.646573:0:6329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 3/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.646584:0:6329:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001af7331/0x92b1eb87ee41e496 lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d21 expref: 45 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.646587:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.646592:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.646594:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.646595:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.646596:0:6329:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 4/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.646615:0:6329:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001af7331/0x92b1eb87ee41e496 lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d21 expref: 45 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.646622:0:6329:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001af7331/0x92b1eb87ee41e496 lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d21 expref: 45 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.646629:0:6329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ba2a942 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6329:1862467659906752:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.646650:0:6329:0:(client.c:2500:ptlrpc_set_wait()) set 000000002966107a going to sleep for 6 seconds 00000100:00100000:0.0:1776187968.646694:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.646745:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425216 00000100:00100000:1.0:1776187968.646779:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15442 00000100:00100000:1.0:1776187968.646783:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008599647e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11414:x1862467653425216:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.646998:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008599647e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11414:x1862467653425216:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 213us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.647006:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15442 00000100:00100000:2.0:1776187968.670349:0:11816:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006b9316eb pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:11816:1862467659905280:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.670381:0:11816:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 3/0,1 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.670773:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.670822:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.670841:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.670906:0:11790:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000013546a3c pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:11790:1862467659906112:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.670919:0:11790:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 3/0,1 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.670943:0:11818:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cdf55e6c pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659906240:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.670953:0:11818:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 3/0,1 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.670979:0:11819:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000035f62d55 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:11819:1862467659905984:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.670990:0:11819:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 3/0,1 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.671017:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425664 00010000:00010000:0.0:1776187968.671046:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f83f7e1/0x92b1eb87ee41eb9d lrc: 5/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ff9 expref: 42 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.671074:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425536 00010000:00010000:0.0:1776187968.671084:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078884edb/0x92b1eb87ee420440 lrc: 4/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a17 expref: 46 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.671100:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425792 00010000:00010000:0.0:1776187968.671109:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a76d044/0x92b1eb87ee420432 lrc: 5/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a09 expref: 43 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.671132:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4375 00000100:00100000:0.0:1776187968.671138:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000582d5fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+43:2224:x1862467653425664:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1776187968.671153:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.671168:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f83f7e1/0x92b1eb87ee41eb9d lrc: 5/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ff9 expref: 43 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.671179:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f83f7e1/0x92b1eb87ee41eb9d lrc: 4/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ff9 expref: 43 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.671189:0:11827:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a10603c3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:11827:1862467659905920:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.671205:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.671206:0:11827:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 3/0,1 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.671314:0:11826:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b2a2aca pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:11826:1862467659904832:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.671331:0:11826:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 3/0,1 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.671354:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4376 00000100:00100000:2.0:1776187968.671359:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007dcbae96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+46:2224:x1862467653425536:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1776187968.671367:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.671371:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078884edb/0x92b1eb87ee420440 lrc: 4/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a17 expref: 46 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.671376:0:11796:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028e219af pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:11796:1862467659905344:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.671381:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078884edb/0x92b1eb87ee420440 lrc: 3/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a17 expref: 46 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.671397:0:11796:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 3/0,1 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.671400:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078884edb/0x92b1eb87ee420440 lrc: 0/0,0 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a17 expref: 46 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.671421:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.671423:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.671426:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 3/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.671436:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 4/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.671436:0:9338:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f83f7e1/0x92b1eb87ee41eb9d lrc: 0/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ff9 expref: 43 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.671467:0:9338:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000843473e1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9338:1862467659906048:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.671476:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.671784:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007dcbae96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+45:2224:x1862467653425536:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 424us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.671792:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4376 00000100:00100000:2.0:1776187968.671810:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4377 00000100:00100000:2.0:1776187968.671814:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005359ef33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:2224:x1862467653425792:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1776187968.671821:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.671825:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a76d044/0x92b1eb87ee420432 lrc: 5/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a09 expref: 42 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.671833:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a76d044/0x92b1eb87ee420432 lrc: 4/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a09 expref: 42 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.671844:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.671846:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.671848:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 3/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.671853:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 4/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.671863:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.671905:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005359ef33 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:2224:x1862467653425792:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 90us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.671910:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4377 00000100:00100000:3.0:1776187968.672022:0:11829:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000946cec49 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:11829:1862467659905152:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.672035:0:11829:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 3/0,1 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.672741:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.672763:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425920 00010000:00010000:2.0:1776187968.672783:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000013fdac8c/0x92b1eb87ee41f2f8 lrc: 4/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22df expref: 45 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.672802:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4378 00000100:00100000:2.0:1776187968.672807:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b2a2aca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+45:2224:x1862467653425920:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1776187968.672816:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.672819:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000013fdac8c/0x92b1eb87ee41f2f8 lrc: 4/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22df expref: 45 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.672829:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000013fdac8c/0x92b1eb87ee41f2f8 lrc: 3/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22df expref: 45 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.672844:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013fdac8c/0x92b1eb87ee41f2f8 lrc: 0/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22df expref: 45 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.672857:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.672859:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.672861:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.672868:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 4/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.672917:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.672928:0:11826:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.672937:0:11826:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.672945:0:11826:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.672951:0:11826:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.672966:0:11826:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187968.673248:0:11826:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d31b3e8a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+42:2996:x1862467659904768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34952us (35695us total) trans 4294968200 rc 0/0 00000100:00100000:2.0:1776187968.673257:0:11826:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2845 00000100:00100000:3.0:1776187968.673564:0:11794:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000077c3b583 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:11794:1862467659906304:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.673586:0:11794:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 3/0,1 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.673900:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.673903:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.673913:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 4/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.673959:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b2a2aca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+44:2224:x1862467653425920:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 1150us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.673968:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4378 00000100:00100000:2.0:1776187968.674021:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.674118:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.674133:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.674155:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.674429:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426048 00010000:00010000:3.0:1776187968.674450:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000069146745/0x92b1eb87ee41e966 lrc: 5/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f04 expref: 42 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.674471:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425984 00010000:00010000:3.0:1776187968.674477:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4dfe39f/0x92b1eb87ee41ee1a lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2103 expref: 43 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.674485:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426112 00010000:00010000:3.0:1776187968.674492:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000af687307/0x92b1eb87ee41f640 lrc: 5/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2421 expref: 44 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.674504:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4379 00000100:00100000:3.0:1776187968.674508:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000138d96d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+43:2224:x1862467653426048:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.674519:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.674522:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000069146745/0x92b1eb87ee41e966 lrc: 5/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f04 expref: 43 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.674530:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000069146745/0x92b1eb87ee41e966 lrc: 4/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f04 expref: 43 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.674548:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.674550:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.674552:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.674557:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 4/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.674572:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.674598:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000138d96d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+43:2224:x1862467653426048:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 89us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.674604:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4379 00000100:00100000:3.0:1776187968.674615:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4380 00000100:00100000:3.0:1776187968.674619:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d65b5018 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:2224:x1862467653425984:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.674624:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.674627:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4dfe39f/0x92b1eb87ee41ee1a lrc: 4/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2103 expref: 42 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.674634:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4dfe39f/0x92b1eb87ee41ee1a lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2103 expref: 42 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.674645:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4dfe39f/0x92b1eb87ee41ee1a lrc: 0/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2103 expref: 42 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.674656:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.674657:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.674659:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.674664:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 4/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.674678:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.674692:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d65b5018 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+41:2224:x1862467653425984:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 72us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.674697:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4380 00000100:00100000:3.0:1776187968.674708:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4381 00000100:00100000:3.0:1776187968.674712:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000267f7899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+44:2224:x1862467653426112:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.674718:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.674721:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000af687307/0x92b1eb87ee41f640 lrc: 5/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2421 expref: 44 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.674727:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000af687307/0x92b1eb87ee41f640 lrc: 4/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2421 expref: 44 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.674739:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.674741:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.674742:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.674747:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 4/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.674758:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.674774:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000267f7899 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+44:2224:x1862467653426112:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 61us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.674779:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4381 00010000:00010000:3.0:1776187968.674796:0:11794:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.674804:0:11794:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.674812:0:11794:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 3/0,1 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.674824:0:11794:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.674839:0:11794:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1776187968.675231:0:11794:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6f393cf pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:2994:x1862467659905408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 31680us (31847us total) trans 4294968164 rc 0/0 00000100:00100000:3.0:1776187968.675239:0:11794:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2856 00010000:00010000:3.0:1776187968.675258:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1776187968.675262:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.675269:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000006942ede already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.675272:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.675279:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 3/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.675291:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 1/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.675297:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006942ede/0x92b1eb87ee43a47a lrc: 0/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.675311:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.675313:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.675324:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000787789d5 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.675326:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 2/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.675332:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 3/0,0 mode: PW/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.675341:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 1/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.675346:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000787789d5/0x92b1eb87ee43a4c7 lrc: 0/0,0 mode: --/PW res: [0x101:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.675356:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.675357:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.675359:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.675633:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.675659:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.675723:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.675735:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.675747:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.675757:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.675772:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.675946:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425280 00010000:00010000:2.0:1776187968.675967:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095fda5b1/0x92b1eb87ee420375 lrc: 4/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29bc expref: 41 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.675985:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425408 00010000:00010000:2.0:1776187968.675994:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdfb02c3/0x92b1eb87ee41df9c lrc: 4/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b1b expref: 42 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.676004:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425600 00010000:00010000:2.0:1776187968.676012:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000513a57e/0x92b1eb87ee420130 lrc: 5/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28c7 expref: 44 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.676023:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425856 00010000:00010000:2.0:1776187968.676030:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d515954/0x92b1eb87ee436b9a lrc: 4/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9f0a expref: 45 pid: 11829 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.676038:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425344 00010000:00010000:2.0:1776187968.676046:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000614c3b95/0x92b1eb87ee41dea0 lrc: 4/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ab9 expref: 43 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.676061:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425472 00010000:00010000:2.0:1776187968.676068:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000012daf3f1/0x92b1eb87ee4202b8 lrc: 4/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c296f expref: 46 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.676078:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653425728 00010000:00010000:2.0:1776187968.676085:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f1b2480/0x92b1eb87ee41ed56 lrc: 4/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20af expref: 44 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.676098:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4382 00000100:00100000:2.0:1776187968.676103:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1f8d60b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+44:2222:x1862467653425280:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.676114:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.676118:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095fda5b1/0x92b1eb87ee420375 lrc: 4/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29bc expref: 44 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676127:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095fda5b1/0x92b1eb87ee420375 lrc: 3/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29bc expref: 44 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676145:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095fda5b1/0x92b1eb87ee420375 lrc: 0/0,0 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c29bc expref: 44 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676156:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676167:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676170:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 3/0,1 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676177:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 4/0,1 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676205:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.676237:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1f8d60b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+43:2222:x1862467653425280:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 132us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.676244:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4382 00000100:00100000:2.0:1776187968.676286:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4383 00000100:00100000:2.0:1776187968.676290:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cc2639a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:2222:x1862467653425408:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.676297:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.676301:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdfb02c3/0x92b1eb87ee41df9c lrc: 4/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b1b expref: 42 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676308:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdfb02c3/0x92b1eb87ee41df9c lrc: 3/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b1b expref: 42 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676321:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdfb02c3/0x92b1eb87ee41df9c lrc: 0/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b1b expref: 42 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676330:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676331:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676333:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676340:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 4/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676357:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.676374:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cc2639a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+41:2222:x1862467653425408:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 83us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.676381:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4383 00000100:00100000:2.0:1776187968.676393:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4384 00000100:00100000:2.0:1776187968.676397:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071940cea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+46:2222:x1862467653425600:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.676403:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.676406:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000513a57e/0x92b1eb87ee420130 lrc: 5/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28c7 expref: 46 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676413:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000513a57e/0x92b1eb87ee420130 lrc: 4/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28c7 expref: 46 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676426:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676428:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676430:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676435:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 4/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676446:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.676461:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071940cea pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+46:2222:x1862467653425600:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 63us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.676466:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4384 00000100:00100000:2.0:1776187968.676476:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4385 00000100:00100000:2.0:1776187968.676480:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030183490 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+45:2222:x1862467653425856:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.676486:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.676488:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d515954/0x92b1eb87ee436b9a lrc: 4/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9f0a expref: 45 pid: 11829 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676496:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d515954/0x92b1eb87ee436b9a lrc: 3/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9f0a expref: 45 pid: 11829 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676507:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d515954/0x92b1eb87ee436b9a lrc: 0/0,0 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c9f0a expref: 45 pid: 11829 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676515:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676517:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676519:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 3/0,1 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676524:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 4/0,1 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676539:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.676554:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030183490 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+44:2222:x1862467653425856:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 73us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.676559:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4385 00000100:00100000:2.0:1776187968.676571:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4386 00000100:00100000:2.0:1776187968.676574:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000946cec49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+40:2222:x1862467653425344:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.676580:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.676583:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000614c3b95/0x92b1eb87ee41dea0 lrc: 4/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ab9 expref: 40 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676592:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000614c3b95/0x92b1eb87ee41dea0 lrc: 3/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ab9 expref: 40 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676610:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000614c3b95/0x92b1eb87ee41dea0 lrc: 0/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ab9 expref: 40 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676619:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676621:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676623:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676629:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 4/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676644:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.676661:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000946cec49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:2222:x1862467653425344:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 86us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.676667:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4386 00000100:00100000:2.0:1776187968.676678:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4387 00000100:00100000:2.0:1776187968.676682:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035f62d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+43:2222:x1862467653425472:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.676689:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.676692:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000012daf3f1/0x92b1eb87ee4202b8 lrc: 4/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c296f expref: 43 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676700:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000012daf3f1/0x92b1eb87ee4202b8 lrc: 3/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c296f expref: 43 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676711:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012daf3f1/0x92b1eb87ee4202b8 lrc: 0/0,0 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c296f expref: 43 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676726:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676727:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676729:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 3/0,1 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676735:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 4/0,1 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676752:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.676771:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035f62d55 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+42:2222:x1862467653425472:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 88us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.676778:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4387 00000100:00100000:2.0:1776187968.676788:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4388 00000100:00100000:2.0:1776187968.676793:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdf55e6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+38:2222:x1862467653425728:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.676799:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.676802:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f1b2480/0x92b1eb87ee41ed56 lrc: 4/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20af expref: 38 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676811:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f1b2480/0x92b1eb87ee41ed56 lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20af expref: 38 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676822:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f1b2480/0x92b1eb87ee41ed56 lrc: 0/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c20af expref: 38 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.676831:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676832:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.676834:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676839:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 4/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676855:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.676870:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdf55e6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+37:2222:x1862467653425728:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 77us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.676902:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4388 00010000:00010000:2.0:1776187968.676926:0:11816:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676934:0:11816:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676944:0:11816:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676950:0:11816:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.676963:0:11816:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187968.677221:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c1aac22 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:2996:x1862467659905216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36526us (36664us total) trans 4294968165 rc 0/0 00000100:00100000:2.0:1776187968.677230:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2848 00010000:00010000:2.0:1776187968.677255:0:11819:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 3/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.677268:0:11819:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 3/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.677274:0:11819:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 3/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.677280:0:11819:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 2/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.677291:0:11819:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1776187968.677612:0:11819:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085fc26ab pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+42:2994:x1862467659904960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36001us (36158us total) trans 4294968201 rc 0/0 00000100:00100000:2.0:1776187968.677618:0:11819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2850 00010000:00010000:2.0:1776187968.677783:0:6326:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af687307/0x92b1eb87ee41f640 lrc: 0/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2421 expref: 41 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.677795:0:6326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000098599a18 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6326:1862467659906496:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.677814:0:6326:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.677820:0:6326:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.677826:0:6326:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.677837:0:6326:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 3/0,1 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.677842:0:6326:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.677849:0:6326:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1776187968.677987:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052710b4a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:2995:x1862467659906432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32222us (32715us total) trans 4294968202 rc 0/0 00000100:00100000:2.0:1776187968.677993:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2858 00010000:00010000:0.0:1776187968.678856:0:11790:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.678869:0:11790:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.678893:0:11790:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 3/0,1 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.678900:0:11790:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.678913:0:11790:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:0.0:1776187968.679205:0:11790:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000894dc1df pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+42:2996:x1862467659905856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36773us (36851us total) trans 4294968166 rc 0/0 00000100:00100000:0.0:1776187968.679214:0:11790:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2853 00010000:00010000:0.0:1776187968.679307:0:11818:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 3/0,1 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.679325:0:11818:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 3/0,1 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.679336:0:11818:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 3/0,1 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.679341:0:11818:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 2/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.679349:0:11818:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:3.0:1776187968.679404:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1776187968.679410:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679419:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005f47f5e7 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.679422:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679431:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 3/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679459:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 1/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679465:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f47f5e7/0x92b1eb87ee43a488 lrc: 0/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679486:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1776187968.679489:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 2/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679495:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000033a084bb already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.679497:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 2/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679504:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 3/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.679514:0:11818:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7a98837 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+42:2994:x1862467659905728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 36007us (36187us total) trans 4294968203 rc 0/0 00010000:00010000:3.0:1776187968.679515:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 1/0,0 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679528:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033a084bb/0x92b1eb87ee43a49d lrc: 0/0,0 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.679528:0:11818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2855 00010000:00010000:3.0:1776187968.679547:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1776187968.679550:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679560:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc9474fb already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.679562:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 2/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679567:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 3/0,0 mode: PW/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679574:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 1/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679580:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a4d5 lrc: 0/0,0 mode: --/PW res: [0x109:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679591:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1776187968.679593:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679598:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a152635 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.679600:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 2/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679604:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 3/0,0 mode: PW/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679611:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 1/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679621:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a4b2 lrc: 0/0,0 mode: --/PW res: [0x100:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679630:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.679632:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 2/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679636:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000063e41381 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.679638:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 2/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679642:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 3/0,0 mode: PW/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679649:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 1/0,0 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679654:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063e41381/0x92b1eb87ee43a4c0 lrc: 0/0,0 mode: --/PW res: [0x1a1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679663:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.679665:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.679666:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.679673:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.679682:0:11829:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679693:0:11829:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679699:0:11829:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679705:0:11829:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.679725:0:11829:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1776187968.679919:0:11829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025fca930 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+42:2996:x1862467659904896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39699us (39842us total) trans 4294968167 rc 0/0 00000100:00100000:3.0:1776187968.679927:0:11829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2846 00000100:00100000:3.0:1776187968.679971:0:6329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ba2a942 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6329:1862467659906752:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.679989:0:6329:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 3/0,1 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.680350:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.680354:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.680362:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004fba2add already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.680364:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.680370:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 3/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.680383:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 1/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.680388:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fba2add/0x92b1eb87ee43a481 lrc: 0/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.680406:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.680408:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.680409:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.681058:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1776187968.681114:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000006d1f0f2e/2, rc 0, transno 870 00000100:00100000:3.0:1776187968.681131:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d1f0f2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659905856:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1776187968.681144:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000ddc6d453/2, rc 0, transno 869 00000100:00100000:3.0:1776187968.681148:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ddc6d453 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659905216:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1776187968.681156:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000041a08231/2, rc 0, transno 871 00000100:00100000:3.0:1776187968.681174:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000041a08231 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659904896:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1776187968.681186:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000003e42c13a/2, rc 0, transno 904 00000100:00100000:3.0:1776187968.681202:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e42c13a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659904768:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1776187968.681232:0:11824:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069146745/0x92b1eb87ee41e966 lrc: 0/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f04 expref: 36 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.681243:0:11824:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006439688d pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:11824:1862467659906368:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.681262:0:11824:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.681271:0:11824:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.681277:0:11824:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.681285:0:11824:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.681292:0:11824:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.681308:0:11824:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1776187968.681425:0:9338:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 4/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.681432:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.681448:0:11827:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 3/0,1 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.681461:0:11827:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 3/0,1 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.681468:0:11827:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 3/0,1 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.681475:0:11827:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 2/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.681493:0:11827:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1776187968.681510:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1776187968.681614:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000093ea1a11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659906816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.681684:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.681764:0:11827:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008fd1dad5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+43:2996:x1862467659905600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39583us (39814us total) trans 4294968168 rc 0/0 00000100:00100000:1.0:1776187968.681775:0:11827:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2851 00000100:00100000:3.0:1776187968.681797:0:11824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db84b536 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+42:2994:x1862467659905664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37657us (38368us total) trans 4294968169 rc 0/0 00000100:00100000:3.0:1776187968.681808:0:11824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2857 00000100:00100000:1.0:1776187968.681813:0:11827:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659906816 00010000:00010000:3.0:1776187968.681834:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000004:00080000:0.0:1776187968.681835:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000002e053a51/2, rc 0, transno 872 00010000:00010000:3.0:1776187968.681839:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.681844:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002e053a51 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659905600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.681851:0:11827:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2861 00010000:00010000:3.0:1776187968.681860:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c48750ea already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.681864:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.681871:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 3/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.681892:0:11827:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e059535c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+42:2996:x1862467659906816:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1776187968.681917:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 1/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1776187968.681923:0:11827:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:243 count 1 00010000:00010000:3.0:1776187968.681931:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c48750ea/0x92b1eb87ee43a4ce lrc: 0/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.681949:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.681950:0:11827:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 3/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.681952:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 2/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.681974:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e3273a0 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.681976:0:11827:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bda42e5a/0x92b1eb87ee41e147 lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bbc expref: 40 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.681978:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 2/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.681994:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.681995:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 3/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.681998:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.682001:0:11827:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 4/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.682009:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 1/0,0 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.682021:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a4a4 lrc: 0/0,0 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.682033:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.682034:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.682036:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.682101:0:11797:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a76d044/0x92b1eb87ee420432 lrc: 0/0,0 mode: --/PW res: [0x11a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a09 expref: 35 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.682114:0:11797:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006afce0ba pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:11797:1862467659906176:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.682129:0:11797:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 3/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.682136:0:11797:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 3/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.682141:0:11797:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 3/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.682147:0:11797:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 3/0,1 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.682153:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000582d5fe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+34:2224:x1862467653425664:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 11011us (11942us total) trans 0 rc 0/0 00010000:00010000:2.0:1776187968.682168:0:11797:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 2/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.682177:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4375 00010000:00010000:2.0:1776187968.682194:0:11797:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187968.682393:0:11797:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008256682a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:2994:x1862467659905472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39011us (39112us total) trans 4294968170 rc 0/0 00000100:00100000:2.0:1776187968.682402:0:11797:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2854 00010000:00010000:2.0:1776187968.682531:0:11795:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000513a57e/0x92b1eb87ee420130 lrc: 0/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28c7 expref: 40 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.682541:0:11795:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a4e5517 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:11795:1862467659905792:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.682551:0:11795:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.682557:0:11795:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.682562:0:11795:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.682567:0:11795:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.682571:0:11795:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.682592:0:11795:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1776187968.682871:0:11795:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000092e338f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+43:2994:x1862467659905024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 41282us (41577us total) trans 4294968204 rc 0/0 00000100:00100000:2.0:1776187968.682930:0:11795:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2849 00010000:00010000:0.0:1776187968.683233:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1776187968.683237:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 2/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.683245:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002adbeaf3 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.683248:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 2/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.683254:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 3/0,0 mode: PW/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.683267:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 1/0,0 mode: --/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.683350:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a4b9 lrc: 0/0,0 mode: --/PW res: [0x11a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.683366:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.683368:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.683374:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9325880 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.683375:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.683381:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 3/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.683391:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 1/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.683396:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9325880/0x92b1eb87ee43a496 lrc: 0/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.683407:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.683408:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.683409:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.683600:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.683707:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.683775:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.683780:0:11792:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d74ae161 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:11792:1862467659906688:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.683797:0:11792:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 3/0,1 mode: --/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.683840:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426304 00010000:00010000:3.0:1776187968.683866:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee437ebe lrc: 4/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca51c expref: 40 pid: 11792 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.683982:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426240 00010000:00010000:3.0:1776187968.683994:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001af7331/0x92b1eb87ee41e496 lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d21 expref: 41 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.684061:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4389 00000100:00100000:2.0:1776187968.684067:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000915f6623 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+41:2223:x1862467653426304:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1776187968.684081:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.684086:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee437ebe lrc: 4/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca51c expref: 41 pid: 11792 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.684096:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee437ebe lrc: 3/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca51c expref: 41 pid: 11792 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.684113:0:5502:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee437ebe lrc: 0/0,0 mode: --/PW res: [0x1a7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca51c expref: 41 pid: 11792 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.684124:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.684125:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.684128:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 3/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.684137:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 4/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.684171:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.684213:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000915f6623 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+40:2223:x1862467653426304:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 144us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.684220:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4389 00000100:00100000:2.0:1776187968.684263:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4390 00000100:00100000:2.0:1776187968.684268:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098599a18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:2224:x1862467653426240:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187968.684274:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.684278:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001af7331/0x92b1eb87ee41e496 lrc: 4/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d21 expref: 39 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.684287:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001af7331/0x92b1eb87ee41e496 lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d21 expref: 39 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.684298:0:5502:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001af7331/0x92b1eb87ee41e496 lrc: 0/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1d21 expref: 39 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.684306:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.684308:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.684309:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.684315:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 4/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.684336:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.684352:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098599a18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+38:2224:x1862467653426240:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 84us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.684359:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4390 00010000:00010000:1.0:1776187968.685410:0:11827:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bda42e5a/0x92b1eb87ee41e147 lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bbc expref: 37 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.685425:0:11827:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bda42e5a/0x92b1eb87ee41e147 lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bbc expref: 37 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.685439:0:11827:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000843473e1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:11827:1862467659906880:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.685496:0:11827:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f5011558 going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.685582:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006afce0ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659907136:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.685618:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1776187968.685660:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000d3eeab83/2, rc 0, transno 906 00000100:00100000:1.0:1776187968.685669:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d3eeab83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659906432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.685679:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1776187968.685684:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a10603c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659906944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.685702:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1776187968.685723:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.685732:0:11796:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 3/0,1 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.685743:0:11796:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 3/0,1 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.685753:0:11796:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 3/0,1 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.685766:0:11796:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 2/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.685781:0:11796:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.686005:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007dcbae96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659907200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.686035:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1776187968.686060:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.686064:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 2/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686071:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.686074:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 2/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686082:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 3/0,0 mode: PW/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686097:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 1/0,0 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686103:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a48f lrc: 0/0,0 mode: --/PW res: [0x119:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686120:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.686121:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.686123:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.686140:0:11829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659907136 00000100:00100000:0.0:1776187968.686187:0:11829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659906944 00000100:00100000:0.0:1776187968.686200:0:11829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659907200 00000100:00100000:0.0:1776187968.686216:0:11829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2862 00000100:00100000:0.0:1776187968.686221:0:11829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006439688d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+43:2995:x1862467659907136:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.686244:0:11829:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:262 count 1 00010000:00010000:0.0:1776187968.686263:0:11829:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 3/0,1 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686433:0:11829:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003dfd4ab/0x92b1eb87ee41f3ed lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c233a expref: 33 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686441:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.686443:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.686444:0:11829:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 4/0,1 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.686459:0:6329:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686465:0:11829:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003dfd4ab/0x92b1eb87ee41f3ed lrc: 3/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c233a expref: 33 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.686467:0:6329:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.686474:0:6329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 3/0,1 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686474:0:11829:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003dfd4ab/0x92b1eb87ee41f3ed lrc: 4/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c233a expref: 33 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.686481:0:6329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.686483:0:11829:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000890f1430 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:11829:1862467659907264:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.686502:0:6329:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.686511:0:11829:0:(client.c:2500:ptlrpc_set_wait()) set 000000009e8ae2a0 going to sleep for 6 seconds 00000100:00100000:0.0:1776187968.686525:0:11790:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2863 00000100:00100000:0.0:1776187968.686529:0:11790:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077c3b583 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+43:2995:x1862467659906944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.686541:0:11790:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:253 count 1 00010000:00010000:0.0:1776187968.686551:0:11790:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 3/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686560:0:11790:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040b51f3c/0x92b1eb87ee41eafc lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fac expref: 33 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686566:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.686567:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.686568:0:11790:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 4/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686582:0:11790:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040b51f3c/0x92b1eb87ee41eafc lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fac expref: 33 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686589:0:11790:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040b51f3c/0x92b1eb87ee41eafc lrc: 4/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fac expref: 33 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.686596:0:11790:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f0a54e30 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:11790:1862467659907328:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.686616:0:11790:0:(client.c:2500:ptlrpc_set_wait()) set 000000005fda74db going to sleep for 6 seconds 00000100:00100000:0.0:1776187968.686629:0:11818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2864 00000100:00100000:0.0:1776187968.686633:0:11818:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005359ef33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+43:2996:x1862467659907200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.686645:0:11818:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:248 count 1 00010000:00010000:0.0:1776187968.686656:0:11818:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 3/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686666:0:11818:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064c8b302/0x92b1eb87ee41e648 lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1dbb expref: 37 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686672:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.686674:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.686675:0:11818:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 4/0,1 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686693:0:11818:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064c8b302/0x92b1eb87ee41e648 lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1dbb expref: 37 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686701:0:11818:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064c8b302/0x92b1eb87ee41e648 lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1dbb expref: 37 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.686708:0:11818:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a6d022f pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659907392:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.686729:0:11818:0:(client.c:2500:ptlrpc_set_wait()) set 00000000edb08996 going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.686742:0:11792:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 3/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686749:0:11792:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 3/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686756:0:11792:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 3/0,1 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686761:0:11792:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 2/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.686774:0:11792:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1776187968.686923:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1776187968.686927:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.686934:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b23405f4 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.686936:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 2/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.686941:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 3/0,0 mode: PW/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.686953:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 1/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.686959:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a4e3 lrc: 0/0,0 mode: --/PW res: [0xf7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.686974:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.686976:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 2/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.686981:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e168beb already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.686983:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 2/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.686989:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 3/0,0 mode: PW/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.687010:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 1/0,0 mode: --/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.687017:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e168beb/0x92b1eb87ee43a4dc lrc: 0/0,0 mode: --/PW res: [0x1a7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.687030:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.687031:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.687032:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.687201:0:11792:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070dcc367 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:2993:x1862467659906560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40777us (41106us total) trans 4294968205 rc 0/0 00000100:00100000:0.0:1776187968.687209:0:11792:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2859 00010000:00010000:0.0:1776187968.687231:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.687251:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000046010e85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659907008:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.687285:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1776187968.687311:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000009b2fcc41/2, rc 0, transno 909 00000100:00100000:0.0:1776187968.687320:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b2fcc41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659906560:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.687363:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659907008 00000100:00100000:0.0:1776187968.687386:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2865 00000100:00100000:0.0:1776187968.687391:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083a94df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:2993:x1862467659907008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.687403:0:6326:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:252 count 1 00010000:00010000:0.0:1776187968.687416:0:6326:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 3/0,1 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687427:0:6326:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f528d49d/0x92b1eb87ee41ea2a lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f58 expref: 33 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687433:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.687434:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.687435:0:6326:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 4/0,1 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687452:0:6326:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f528d49d/0x92b1eb87ee41ea2a lrc: 3/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f58 expref: 33 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687459:0:6326:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f528d49d/0x92b1eb87ee41ea2a lrc: 4/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f58 expref: 33 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.687468:0:6326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000344f6d72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6326:1862467659907520:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.687490:0:6326:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f28305b6 going to sleep for 6 seconds 00000100:00100000:0.0:1776187968.687507:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000ee3389a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659907456:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.687579:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.687592:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1776187968.687596:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089eb1245 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659907072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.687613:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.687634:0:11819:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659907456 00000100:00100000:0.0:1776187968.687654:0:11819:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659907072 00000100:00100000:0.0:1776187968.687670:0:11819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2866 00000100:00100000:0.0:1776187968.687673:0:11819:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000927d9240 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+44:2993:x1862467659907456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.687684:0:11819:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:249 count 1 00010000:00010000:0.0:1776187968.687697:0:11819:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 3/0,1 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687708:0:11819:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a233904/0x92b1eb87ee41e744 lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e1d expref: 37 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687714:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.687715:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.687716:0:11819:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 4/0,1 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687735:0:11819:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a233904/0x92b1eb87ee41e744 lrc: 3/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e1d expref: 37 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687743:0:11819:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a233904/0x92b1eb87ee41e744 lrc: 4/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e1d expref: 37 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.687750:0:11819:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb87fcf0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:11819:1862467659907584:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.687774:0:11819:0:(client.c:2500:ptlrpc_set_wait()) set 000000006d65048d going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.687791:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2867 00000100:00100000:0.0:1776187968.687795:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd82bb7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:2993:x1862467659907072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.687807:0:11816:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:261 count 1 00010000:00010000:0.0:1776187968.687817:0:11816:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 3/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687826:0:11816:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003026ca16/0x92b1eb87ee41f2f1 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22d8 expref: 33 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687832:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.687833:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.687834:0:11816:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 4/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687849:0:11816:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003026ca16/0x92b1eb87ee41f2f1 lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22d8 expref: 33 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.687855:0:11816:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003026ca16/0x92b1eb87ee41f2f1 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22d8 expref: 33 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.687863:0:11816:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000618c42d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:11816:1862467659907648:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.687902:0:11816:0:(client.c:2500:ptlrpc_set_wait()) set 000000007b7bbbbe going to sleep for 6 seconds 00000100:00100000:1.0:1776187968.688504:0:11796:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca963743 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:2996:x1862467659905088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 47852us (48165us total) trans 4294968206 rc 0/0 00000100:00100000:1.0:1776187968.688514:0:11796:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2847 00000004:00080000:1.0:1776187968.688573:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000002cd66b6b/2, rc 0, transno 868 00000100:00100000:1.0:1776187968.688583:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002cd66b6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659905408:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1776187968.688593:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000001ee6948/2, rc 0, transno 873 00000100:00100000:1.0:1776187968.688596:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000001ee6948 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659905664:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1776187968.688605:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000f43bbdf3/2, rc 0, transno 874 00000100:00100000:1.0:1776187968.688608:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f43bbdf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659905472:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1776187968.688617:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000071fa85c3/2, rc 0, transno 907 00000100:00100000:1.0:1776187968.688626:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000071fa85c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659905728:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1776187968.688635:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000dd1918da/2, rc 0, transno 905 00000100:00100000:1.0:1776187968.688638:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd1918da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659904960:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1776187968.688644:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000050642aa4/2, rc 0, transno 908 00000100:00100000:1.0:1776187968.688647:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000050642aa4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659905024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.688717:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a4e5517 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659907776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.688743:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.688761:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1776187968.688766:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000028e219af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659907840:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.688785:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.688805:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659907776 00000100:00100000:1.0:1776187968.688827:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659907840 00000100:00100000:1.0:1776187968.688841:0:11796:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2868 00000100:00100000:1.0:1776187968.688845:0:11796:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000226d82a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:2995:x1862467659907776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.688901:0:11796:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:283 count 1 00010000:00010000:1.0:1776187968.688918:0:11796:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 3/0,1 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.688933:0:11796:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000098242551/0x92b1eb87ee4204f6 lrc: 2/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a56 expref: 33 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.688940:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.688942:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.688943:0:11796:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 4/0,1 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.688965:0:11796:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000098242551/0x92b1eb87ee4204f6 lrc: 3/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a56 expref: 33 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.688975:0:11796:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000098242551/0x92b1eb87ee4204f6 lrc: 4/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a56 expref: 33 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.688986:0:11796:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004e3eea26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:11796:1862467659907904:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.689853:0:11796:0:(client.c:2500:ptlrpc_set_wait()) set 00000000bf3baaf3 going to sleep for 6 seconds 00000100:00100000:3.0:1776187968.689902:0:6329:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f42d7af2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:2994:x1862467659906624:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43348us (43785us total) trans 4294968207 rc 0/0 00000100:00100000:1.0:1776187968.689908:0:11826:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2869 00000100:00100000:3.0:1776187968.689915:0:6329:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2860 00000100:00100000:1.0:1776187968.689918:0:11826:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a205269b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+47:2995:x1862467659907840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.689944:0:11826:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:277 count 1 00010000:00010000:1.0:1776187968.689962:0:11826:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 3/0,1 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.689976:0:11826:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000232bfc85/0x92b1eb87ee420050 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c285e expref: 33 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.689983:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.689985:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.689986:0:11826:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 4/0,1 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.690076:0:11826:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000232bfc85/0x92b1eb87ee420050 lrc: 3/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c285e expref: 33 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.690087:0:11826:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000232bfc85/0x92b1eb87ee420050 lrc: 4/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c285e expref: 33 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.690100:0:11826:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6e3f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:11826:1862467659907968:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.690395:0:11826:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c87ea308 going to sleep for 6 seconds 00000100:00100000:1.0:1776187968.690417:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d74ae161 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659907712:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1776187968.690496:0:11827:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000843473e1 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:11827:1862467659906880:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.690524:0:11827:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 3/0,1 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.690540:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187968.690572:0:6329:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659907712 00000004:00080000:1.0:1776187968.690578:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000be51259f/2, rc 0, transno 911 00000100:00100000:1.0:1776187968.690584:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000be51259f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659906624:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187968.690613:0:6329:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2870 00000100:00100000:3.0:1776187968.690619:0:6329:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e3696e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:2994:x1862467659907712:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.690641:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426176 00002000:00080000:3.0:1776187968.690650:0:6329:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:264 count 1 00010000:00010000:3.0:1776187968.690669:0:6329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 3/0,1 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.690678:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15443 00010000:00010000:3.0:1776187968.690684:0:6329:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000087cf5aac/0x92b1eb87ee41f639 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c241a expref: 33 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.690686:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f732f2c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11414:x1862467653426176:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00010000:00010000:3.0:1776187968.690698:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.690700:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.690701:0:6329:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 4/0,1 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.690721:0:6329:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000087cf5aac/0x92b1eb87ee41f639 lrc: 3/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c241a expref: 33 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.690729:0:6329:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000087cf5aac/0x92b1eb87ee41f639 lrc: 4/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c241a expref: 33 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.690742:0:6329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e08d0c88 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6329:1862467659908032:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187968.690769:0:6329:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c391d1e7 going to sleep for 6 seconds 00000100:00100000:1.0:1776187968.690899:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f732f2c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11414:x1862467653426176:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 213us (16743us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.690909:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15443 00010000:00010000:1.0:1776187968.690937:0:9338:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.690946:0:9338:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.690953:0:9338:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 3/0,1 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.690959:0:9338:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.690977:0:9338:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1776187968.691025:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.691050:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426368 00010000:00010000:3.0:1776187968.691067:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bda42e5a/0x92b1eb87ee41e147 lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bbc expref: 38 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.691088:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4391 00000100:00100000:3.0:1776187968.691092:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7aa3d8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+38:2225:x1862467653426368:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1776187968.691102:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.691106:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bda42e5a/0x92b1eb87ee41e147 lrc: 4/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bbc expref: 38 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.691117:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bda42e5a/0x92b1eb87ee41e147 lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bbc expref: 38 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.691138:0:11830:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bda42e5a/0x92b1eb87ee41e147 lrc: 0/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1bbc expref: 38 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.691152:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.691170:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.691173:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.691182:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 4/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.691207:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187968.691216:0:11827:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.691224:0:11827:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.691231:0:11827:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 3/0,1 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.691237:0:11827:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.691251:0:11827:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1776187968.691334:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000030fe3c5/2, rc 0, transno 910 00000100:00100000:0.0:1776187968.691340:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000030fe3c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659905088:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.691541:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cfad8e60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659908224:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.691580:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.691607:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1776187968.691613:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000083801d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659908288:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.692334:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.692569:0:11824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659908224 00000100:00100000:1.0:1776187968.692603:0:11824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659908288 00000100:00100000:1.0:1776187968.692619:0:11824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2871 00000100:00100000:1.0:1776187968.692625:0:11824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b117547 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+47:2995:x1862467659908224:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.692651:0:11824:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:266 count 1 00010000:00010000:1.0:1776187968.692672:0:11824:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 3/0,1 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.692689:0:11824:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000541ec9ed/0x92b1eb87ee41f73c lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2483 expref: 37 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.692696:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.692698:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.692700:0:11824:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 4/0,1 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.692728:0:11824:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000541ec9ed/0x92b1eb87ee41f73c lrc: 3/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2483 expref: 37 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.692739:0:11824:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000541ec9ed/0x92b1eb87ee41f73c lrc: 4/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2483 expref: 37 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.692751:0:11824:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e5b78340 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:11824:1862467659908416:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.694151:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000294394ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659908160:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.694209:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.694238:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1776187968.694244:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000030d971c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659908096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.694264:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.694271:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd9a9483 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659908352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.694287:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1776187968.694303:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1776187968.694309:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.694319:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000550d135e already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.694323:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 2/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.694331:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 3/0,0 mode: PW/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.694350:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 1/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.694356:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000550d135e/0x92b1eb87ee43a4ab lrc: 0/0,0 mode: --/PW res: [0xfe:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.694375:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.694378:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.694384:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.694386:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 2/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.694391:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 3/0,0 mode: PW/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.694490:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 1/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.694496:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a4ea lrc: 0/0,0 mode: --/PW res: [0xf3:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.694511:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.694512:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.694513:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.694539:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659908160 00000100:00100000:0.0:1776187968.694568:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659908096 00000100:00100000:0.0:1776187968.694576:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659908352 00000100:00100000:0.0:1776187968.694585:0:11795:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2872 00000100:00100000:0.0:1776187968.694590:0:11795:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e0ae52a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:2995:x1862467659908288:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.694616:0:11795:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:269 count 1 00010000:00010000:0.0:1776187968.695265:0:11795:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 3/0,1 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695284:0:11795:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000989cf477/0x92b1eb87ee41f9ab lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c258d expref: 37 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695292:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.695294:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.695296:0:11795:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 4/0,1 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695331:0:11795:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000989cf477/0x92b1eb87ee41f9ab lrc: 3/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c258d expref: 37 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695342:0:11795:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000989cf477/0x92b1eb87ee41f9ab lrc: 4/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c258d expref: 37 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.695355:0:11795:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db1b501c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:11795:1862467659908480:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.695407:0:11795:0:(client.c:2500:ptlrpc_set_wait()) set 000000005dfab2e0 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.695433:0:11794:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2873 00000100:00100000:0.0:1776187968.695439:0:11794:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad791b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:2994:x1862467659908160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.695456:0:11794:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:250 count 1 00010000:00010000:0.0:1776187968.695470:0:11794:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 3/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695481:0:11794:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035d95985/0x92b1eb87ee41e808 lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e71 expref: 37 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695486:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.695487:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.695489:0:11794:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 4/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695512:0:11794:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035d95985/0x92b1eb87ee41e808 lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e71 expref: 37 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695521:0:11794:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035d95985/0x92b1eb87ee41e808 lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e71 expref: 37 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.695529:0:11794:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f0afe19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:11794:1862467659908544:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.695548:0:11794:0:(client.c:2500:ptlrpc_set_wait()) set 000000002966107a going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.695565:0:11825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2874 00000100:00100000:0.0:1776187968.695570:0:11825:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000249e47c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+50:2994:x1862467659908096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.695583:0:11825:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:273 count 1 00010000:00010000:0.0:1776187968.695593:0:11825:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 3/0,1 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695603:0:11825:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c8a5644/0x92b1eb87ee41fcbb lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26dd expref: 37 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695610:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.695611:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.695612:0:11825:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 4/0,1 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.695629:0:11825:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c8a5644/0x92b1eb87ee41fcbb lrc: 3/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26dd expref: 37 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.697009:0:11827:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e059535c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+50:2996:x1862467659906816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15142us (15319us total) trans 4294968208 rc 0/0 00000100:00100000:3.0:1776187968.697024:0:11827:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2861 00000100:00100000:3.0:1776187968.697061:0:11827:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2875 00000100:00100000:3.0:1776187968.697067:0:11827:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025c71879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+49:2994:x1862467659908352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1776187968.697091:0:11827:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:251 count 1 00010000:00010000:3.0:1776187968.697112:0:11827:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 3/0,1 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.697128:0:11827:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069741cbe/0x92b1eb87ee41e8cc lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ec5 expref: 37 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.697135:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.697137:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.697139:0:11827:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 4/0,1 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.697379:0:11825:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c8a5644/0x92b1eb87ee41fcbb lrc: 4/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26dd expref: 37 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.697393:0:11825:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007e46ee9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:11825:1862467659908608:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.697580:0:11825:0:(client.c:2500:ptlrpc_set_wait()) set 000000008546d52d going to sleep for 43 seconds 00000004:00080000:0.0:1776187968.697634:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000093ea1a11/2, rc 0, transno 912 00010000:00010000:3.0:1776187968.697668:0:11827:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069741cbe/0x92b1eb87ee41e8cc lrc: 3/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ec5 expref: 37 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.697679:0:11827:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069741cbe/0x92b1eb87ee41e8cc lrc: 4/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ec5 expref: 37 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.697688:0:11827:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e8f5ee10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:11827:1862467659908672:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187968.697708:0:11827:0:(client.c:2500:ptlrpc_set_wait()) set 00000000969e28c2 going to sleep for 43 seconds 00010000:00010000:3.0:1776187968.697724:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187968.697872:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7aa3d8e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+37:2225:x1862467653426368:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 6777us (6847us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.697901:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4391 00000100:00100000:3.0:1776187968.697963:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.698037:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.698066:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426560 00000100:00100000:3.0:1776187968.698102:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4521 00000100:00100000:3.0:1776187968.698106:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e13c69aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+39:11406:x1862467653426560:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:1.0:1776187968.699226:0:11824:0:(client.c:2500:ptlrpc_set_wait()) set 0000000026fd70c8 going to sleep for 43 seconds 00000100:00100000:3.0:1776187968.699460:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e13c69aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+40:11406:x1862467653426560:12345-192.168.204.20@tcp:35:rm.0 Request processed in 203us (274us total) trans 4294975142 rc 0/0 00000100:00100000:3.0:1776187968.699473:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4521 00000100:00100000:1.0:1776187968.699721:0:9338:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000416f053d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:2996:x1862467659905536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 57313us (57642us total) trans 4294968171 rc 0/0 00000100:00100000:1.0:1776187968.699729:0:9338:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2852 00000100:00100000:3.0:1776187968.700123:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.700177:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.700203:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426688 00010000:00010000:3.0:1776187968.700228:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040b51f3c/0x92b1eb87ee41eafc lrc: 5/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fac expref: 34 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.700253:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000093ea1a11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659906816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187968.700255:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426624 00010000:00010000:3.0:1776187968.700267:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003dfd4ab/0x92b1eb87ee41f3ed lrc: 5/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c233a expref: 35 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.700292:0:11790:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f0a54e30 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:11790:1862467659907328:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187968.700293:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4392 00000100:00100000:3.0:1776187968.700306:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe5c9b61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+35:2223:x1862467653426688:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1776187968.700316:0:11790:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 3/0,1 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.700392:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426432 00010000:00010000:3.0:1776187968.700416:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.700422:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040b51f3c/0x92b1eb87ee41eafc lrc: 4/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fac expref: 35 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.700433:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040b51f3c/0x92b1eb87ee41eafc lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fac expref: 35 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.700457:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040b51f3c/0x92b1eb87ee41eafc lrc: 0/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1fac expref: 35 pid: 11816 timeout: 545 lvb_type: 0 00000004:00080000:1.0:1776187968.700467:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000827745c3/2, rc 0, transno 875 00010000:00010000:3.0:1776187968.700473:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.700476:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.700479:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.700481:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000827745c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659905536:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1776187968.700495:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 4/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.700509:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15444 00000100:00100000:0.0:1776187968.700516:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e144210c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+40:11414:x1862467653426432:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00010000:00010000:3.0:1776187968.700523:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.700529:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1776187968.700547:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe5c9b61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+34:2223:x1862467653426688:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 240us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.700547:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000218fbb0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659908800:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1776187968.700559:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4392 00000100:00100000:3.0:1776187968.700576:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4393 00000100:00100000:3.0:1776187968.700583:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000843473e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+33:2223:x1862467653426624:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00000100:00100000:1.0:1776187968.700591:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1776187968.700592:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.700597:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003dfd4ab/0x92b1eb87ee41f3ed lrc: 5/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c233a expref: 33 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.700610:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003dfd4ab/0x92b1eb87ee41f3ed lrc: 4/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c233a expref: 33 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.700622:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1776187968.700633:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001b161714 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659908736:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.700658:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.700677:0:10783:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659908800 00000100:00100000:1.0:1776187968.700698:0:10783:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659908736 00000100:00100000:1.0:1776187968.700713:0:10783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2876 00000100:00100000:1.0:1776187968.700716:0:10783:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000058b4d758 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:2996:x1862467659908800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.700733:0:10783:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:259 count 1 00010000:00010000:1.0:1776187968.700753:0:10783:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 3/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.700767:0:10783:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000895db5b5/0x92b1eb87ee41f090 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21ea expref: 33 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.700774:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.700775:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.700776:0:10783:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 4/0,1 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.700797:0:10783:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000895db5b5/0x92b1eb87ee41f090 lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21ea expref: 33 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.700807:0:10783:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000895db5b5/0x92b1eb87ee41f090 lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21ea expref: 33 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.700817:0:10783:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f692565e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10783:1862467659908864:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.700839:0:10783:0:(client.c:2500:ptlrpc_set_wait()) set 000000009e2d7a44 going to sleep for 6 seconds 00000100:00100000:0.0:1776187968.701132:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e144210c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+40:11414:x1862467653426432:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 617us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.701140:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15444 00010000:00010000:0.0:1776187968.701187:0:11790:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.701195:0:11790:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.701203:0:11790:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 3/0,1 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.701210:0:11790:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.701227:0:11790:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.701305:0:11797:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2877 00000100:00100000:1.0:1776187968.701310:0:11797:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073816638 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:2993:x1862467659908736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.701326:0:11797:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:274 count 1 00010000:00010000:1.0:1776187968.701399:0:11797:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 3/0,1 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.701413:0:11797:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000063faacd9/0x92b1eb87ee41fd7f lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2731 expref: 36 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.701420:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.701422:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.701424:0:11797:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 4/0,1 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.701445:0:11797:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000063faacd9/0x92b1eb87ee41fd7f lrc: 3/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2731 expref: 36 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.701453:0:11797:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000063faacd9/0x92b1eb87ee41fd7f lrc: 4/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2731 expref: 36 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.701463:0:11797:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016e0d7aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:11797:1862467659908928:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.701485:0:11797:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ae9f50cc going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.702183:0:11790:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077c3b583 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:2995:x1862467659906944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15650us (16477us total) trans 4294968172 rc 0/0 00000100:00100000:0.0:1776187968.702191:0:11790:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2863 00010000:00010000:0.0:1776187968.702217:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.702221:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.702229:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f73ddd4f already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.702232:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 2/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.702239:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 3/0,0 mode: PW/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.702254:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 1/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.702259:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a4f8 lrc: 0/0,0 mode: --/PW res: [0xfd:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.702273:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.702274:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.702275:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.702302:0:11829:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003dfd4ab/0x92b1eb87ee41f3ed lrc: 0/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c233a expref: 33 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.702317:0:11829:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000890f1430 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:11829:1862467659907264:192.168.204.20@tcp:104: 00000004:00080000:1.0:1776187968.702403:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000a10603c3/2, rc 0, transno 876 00000100:00100000:1.0:1776187968.702417:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a10603c3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659906944:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.702470:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1776187968.702481:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d58dfd0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659908992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.702512:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1776187968.705599:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.705608:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.705613:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.705706:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 4/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.706213:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187968.706325:0:11829:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 4/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.706361:0:11790:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659908992 00000100:00100000:0.0:1776187968.706417:0:11790:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2878 00000100:00100000:0.0:1776187968.706423:0:11790:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b0b6bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:2995:x1862467659908992:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1776187968.706447:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:0.0:1776187968.706457:0:11790:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:280 count 1 00010000:00010000:0.0:1776187968.706483:0:11790:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 3/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.706498:0:11790:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a4bc40e/0x92b1eb87ee42029c lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2961 expref: 32 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.706500:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000843473e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+32:2223:x1862467653426624:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 5914us (6320us total) trans 0 rc 0/0 00010000:00010000:0.0:1776187968.706514:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.706516:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1776187968.706519:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4393 00010000:00010000:0.0:1776187968.706519:0:11790:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 4/0,1 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.706542:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426752 00010000:00010000:0.0:1776187968.706551:0:11790:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a4bc40e/0x92b1eb87ee42029c lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2961 expref: 31 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.706562:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064c8b302/0x92b1eb87ee41e648 lrc: 5/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1dbb expref: 37 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.706565:0:11790:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a4bc40e/0x92b1eb87ee42029c lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2961 expref: 31 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.706591:0:11790:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007b68c7c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:11790:1862467659909056:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187968.706606:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4394 00000100:00100000:3.0:1776187968.706611:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004be81521 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+37:2225:x1862467653426752:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.706621:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1776187968.706650:0:11790:0:(client.c:2500:ptlrpc_set_wait()) set 000000009e8ae2a0 going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.706665:0:11829:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.706672:0:11829:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.706681:0:11829:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 3/0,1 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.706687:0:11829:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.706703:0:11829:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1776187968.706710:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064c8b302/0x92b1eb87ee41e648 lrc: 5/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1dbb expref: 37 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.706725:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064c8b302/0x92b1eb87ee41e648 lrc: 4/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1dbb expref: 37 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.706825:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.706827:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.706829:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.706836:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 4/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.706850:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.706871:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004be81521 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+37:2225:x1862467653426752:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 260us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.706896:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4394 00000100:00100000:0.0:1776187968.707047:0:11829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006439688d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+51:2995:x1862467659907136:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20824us (21429us total) trans 4294968173 rc 0/0 00000100:00100000:0.0:1776187968.707054:0:11829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2862 00010000:00010000:0.0:1776187968.707081:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.707086:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1776187968.707094:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000006afce0ba/2, rc 0, transno 877 00010000:00010000:0.0:1776187968.707095:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.707101:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 2/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.707108:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006afce0ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659907136:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.707109:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 3/0,0 mode: PW/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.707129:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 1/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.707134:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000143824d6/0x92b1eb87ee43a4f1 lrc: 0/0,0 mode: --/PW res: [0x106:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.707149:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.707150:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.707151:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.709810:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187968.709833:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000862e5412 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659909120:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.709938:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.709981:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659909120 00000100:00100000:1.0:1776187968.710039:0:9338:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2879 00000100:00100000:1.0:1776187968.710046:0:9338:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5db700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:2994:x1862467659909120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.710081:0:9338:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:260 count 1 00010000:00010000:1.0:1776187968.710117:0:9338:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 3/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.710141:0:9338:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001299cda8/0x92b1eb87ee41f162 lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2245 expref: 31 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.710156:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.710168:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.710170:0:9338:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 4/0,1 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.710199:0:9338:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001299cda8/0x92b1eb87ee41f162 lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2245 expref: 31 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.710211:0:9338:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001299cda8/0x92b1eb87ee41f162 lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2245 expref: 31 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.710333:0:9338:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b776bd0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9338:1862467659909184:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.710391:0:9338:0:(client.c:2500:ptlrpc_set_wait()) set 000000007314a1a7 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.710943:0:11819:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb87fcf0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:11819:1862467659907584:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.710970:0:11819:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 3/0,1 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.711356:0:11818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064c8b302/0x92b1eb87ee41e648 lrc: 0/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1dbb expref: 36 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.711375:0:11818:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a6d022f pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659907392:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.711387:0:11818:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.711395:0:11818:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.711400:0:11818:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.711408:0:11818:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 3/0,1 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.711416:0:11818:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.711442:0:11818:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1776187968.711560:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.711566:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.711575:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.711578:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 2/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.711587:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 3/0,0 mode: PW/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.711617:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 1/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.711622:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a4ff lrc: 0/0,0 mode: --/PW res: [0xf8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.711654:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.711656:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.711657:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.711807:0:11818:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005359ef33 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+51:2996:x1862467659907200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25170us (25769us total) trans 4294968209 rc 0/0 00000100:00100000:2.0:1776187968.711818:0:11818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2864 00000004:00080000:1.0:1776187968.713428:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000007dcbae96/2, rc 0, transno 913 00000100:00100000:1.0:1776187968.713454:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007dcbae96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659907200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.713604:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1776187968.713622:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb87fcf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659909248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.713682:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.713726:0:6326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000344f6d72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6326:1862467659907520:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.713746:0:6326:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 3/0,1 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.716246:0:11818:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659909248 00000100:00100000:2.0:1776187968.716321:0:11818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2880 00000100:00100000:2.0:1776187968.716328:0:11818:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012fd664c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+51:2993:x1862467659909248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187968.716366:0:11818:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:277 count 1 00010000:00010000:2.0:1776187968.716399:0:11818:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 3/0,1 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.716422:0:11818:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098280645/0x92b1eb87ee41ffa8 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c281f expref: 35 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.716431:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.716433:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.716435:0:11818:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 4/0,1 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.716485:0:11818:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098280645/0x92b1eb87ee41ffa8 lrc: 3/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c281f expref: 35 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.716498:0:11818:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098280645/0x92b1eb87ee41ffa8 lrc: 4/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c281f expref: 35 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.716514:0:11818:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000946cec49 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659909312:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.716605:0:11818:0:(client.c:2500:ptlrpc_set_wait()) set 000000001b578632 going to sleep for 43 seconds 00000100:00100000:3.0:1776187968.721217:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.721341:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.721396:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426816 00000100:00100000:0.0:1776187968.721440:0:11816:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000618c42d3 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:11816:1862467659907648:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.721454:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a233904/0x92b1eb87ee41e744 lrc: 4/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e1d expref: 36 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.721483:0:11816:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 3/0,1 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.721512:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426944 00010000:00010000:3.0:1776187968.721524:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003026ca16/0x92b1eb87ee41f2f1 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22d8 expref: 32 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.721556:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4395 00000100:00100000:3.0:1776187968.721562:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ba2a942 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+36:2224:x1862467653426816:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1776187968.721584:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1776187968.721588:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4396 00010000:00010000:3.0:1776187968.721591:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a233904/0x92b1eb87ee41e744 lrc: 4/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e1d expref: 36 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.721598:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000979c8d84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+32:2223:x1862467653426944:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.721610:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a233904/0x92b1eb87ee41e744 lrc: 3/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e1d expref: 36 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.721613:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187968.721620:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003026ca16/0x92b1eb87ee41f2f1 lrc: 4/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22d8 expref: 32 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.721637:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003026ca16/0x92b1eb87ee41f2f1 lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22d8 expref: 32 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.721645:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a233904/0x92b1eb87ee41e744 lrc: 0/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e1d expref: 36 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.721664:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.721667:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.721671:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.721672:0:11830:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003026ca16/0x92b1eb87ee41f2f1 lrc: 0/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c22d8 expref: 32 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.721695:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 4/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.721700:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.721702:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187968.721704:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.721713:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 4/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.721735:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.721737:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.721757:0:11819:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.721764:0:11819:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.721773:0:11819:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 3/0,1 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.721780:0:11819:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.721788:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ba2a942 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+35:2224:x1862467653426816:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 223us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.721798:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4395 00000100:00100000:3.0:1776187968.721894:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187968.721992:0:11819:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1776187968.722018:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.722035:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653426880 00010000:00010000:3.0:1776187968.722051:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f528d49d/0x92b1eb87ee41ea2a lrc: 4/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f58 expref: 32 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.722190:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427008 00010000:00010000:3.0:1776187968.722207:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000098242551/0x92b1eb87ee4204f6 lrc: 5/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a56 expref: 33 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.722233:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4397 00000100:00100000:3.0:1776187968.722237:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e5ee0d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+33:2223:x1862467653426880:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.722247:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.722250:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f528d49d/0x92b1eb87ee41ea2a lrc: 4/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f58 expref: 33 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.722262:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f528d49d/0x92b1eb87ee41ea2a lrc: 3/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f58 expref: 33 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.722279:0:11842:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f528d49d/0x92b1eb87ee41ea2a lrc: 0/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1f58 expref: 33 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.722292:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.722293:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.722295:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722303:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 4/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722324:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.722353:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e5ee0d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+32:2223:x1862467653426880:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 114us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.722360:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4397 00000100:00100000:3.0:1776187968.722380:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4398 00000100:00100000:3.0:1776187968.722384:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ba94a74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+31:2223:x1862467653427008:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.722391:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.722395:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000098242551/0x92b1eb87ee4204f6 lrc: 5/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a56 expref: 31 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.722405:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000098242551/0x92b1eb87ee4204f6 lrc: 4/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a56 expref: 31 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.722430:0:11819:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000927d9240 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+52:2993:x1862467659907456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34754us (34850us total) trans 4294968210 rc 0/0 00000100:00100000:0.0:1776187968.722439:0:11819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2866 00010000:00010000:0.0:1776187968.722463:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.722469:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.722477:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d612a45d already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.722482:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 2/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722483:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.722486:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.722489:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 3/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.722494:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 3/0,0 mode: PW/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722506:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 4/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.722514:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 1/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.722521:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d612a45d/0x92b1eb87ee43a50d lrc: 0/0,0 mode: --/PW res: [0xf9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722523:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.722538:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.722541:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.722543:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187968.722544:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ba94a74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+31:2223:x1862467653427008:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 158us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.722553:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4398 00010000:00010000:0.0:1776187968.722554:0:11816:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.722562:0:11816:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.722574:0:11816:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 3/0,1 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.722581:0:11816:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.722597:0:11816:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1776187968.722604:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.722720:0:6329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e08d0c88 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6329:1862467659908032:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.722780:0:6329:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 3/0,1 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.722813:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.722831:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427200 00010000:00010000:3.0:1776187968.722846:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000087cf5aac/0x92b1eb87ee41f639 lrc: 4/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c241a expref: 31 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.722866:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4399 00000100:00100000:3.0:1776187968.722870:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000942efc84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+31:2223:x1862467653427200:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.722895:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.722899:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000087cf5aac/0x92b1eb87ee41f639 lrc: 4/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c241a expref: 31 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.722907:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000087cf5aac/0x92b1eb87ee41f639 lrc: 3/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c241a expref: 31 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.722919:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087cf5aac/0x92b1eb87ee41f639 lrc: 0/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c241a expref: 31 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.722928:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.722929:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.722931:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722938:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 4/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722953:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1776187968.722962:0:6329:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722968:0:6329:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722974:0:6329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722980:0:6329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.722994:0:6329:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1776187968.723154:0:6329:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e3696e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:2994:x1862467659907712:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32533us (32615us total) trans 4294968174 rc 0/0 00000100:00100000:3.0:1776187968.723173:0:6329:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2870 00000100:00100000:3.0:1776187968.723205:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000942efc84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:2223:x1862467653427200:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 335us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.723211:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4399 00000100:00100000:3.0:1776187968.723238:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.723253:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427136 00010000:00010000:3.0:1776187968.723265:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000232bfc85/0x92b1eb87ee420050 lrc: 5/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c285e expref: 30 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.723293:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4400 00000100:00100000:3.0:1776187968.723297:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007485566e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:2225:x1862467653427136:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1776187968.723305:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.723308:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000232bfc85/0x92b1eb87ee420050 lrc: 5/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c285e expref: 30 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.723315:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000232bfc85/0x92b1eb87ee420050 lrc: 4/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c285e expref: 30 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.723327:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.723329:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.723330:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.723336:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 4/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.723348:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.723363:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007485566e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:2225:x1862467653427136:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 65us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.723369:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4400 00000100:00100000:3.0:1776187968.723487:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.723500:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427264 00010000:00010000:3.0:1776187968.723511:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000989cf477/0x92b1eb87ee41f9ab lrc: 5/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c258d expref: 35 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.723534:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4401 00000100:00100000:3.0:1776187968.723538:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fe90f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+35:2225:x1862467653427264:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.723546:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.723549:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000989cf477/0x92b1eb87ee41f9ab lrc: 5/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c258d expref: 35 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.723556:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000989cf477/0x92b1eb87ee41f9ab lrc: 4/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c258d expref: 35 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.723570:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.723571:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.723573:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.723579:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 4/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.723590:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.723607:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fe90f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+35:2225:x1862467653427264:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 68us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.723612:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4401 00010000:00010000:1.0:1776187968.726630:0:11796:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098242551/0x92b1eb87ee4204f6 lrc: 0/0,0 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2a56 expref: 29 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.726652:0:11796:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004e3eea26 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:11796:1862467659907904:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.726681:0:11796:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 3/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.726691:0:11796:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 3/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.726703:0:11796:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 3/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.726712:0:11796:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 3/0,1 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.726719:0:11796:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 2/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.726753:0:11796:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1776187968.727019:0:11796:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000226d82a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:2995:x1862467659907776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 38172us (38274us total) trans 4294968175 rc 0/0 00000100:00100000:1.0:1776187968.727029:0:11796:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2868 00010000:00010000:1.0:1776187968.727081:0:11826:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000232bfc85/0x92b1eb87ee420050 lrc: 0/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c285e expref: 28 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.727091:0:11826:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6e3f9b5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:11826:1862467659907968:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.727103:0:11826:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727109:0:11826:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727113:0:11826:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727124:0:11826:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727128:0:11826:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727135:0:11826:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:1.0:1776187968.727267:0:11826:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a205269b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+52:2995:x1862467659907840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37351us (38481us total) trans 4294968176 rc 0/0 00000100:00100000:1.0:1776187968.727273:0:11826:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2869 00000004:00080000:1.0:1776187968.727309:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000028e219af/2, rc 0, transno 880 00000100:00100000:1.0:1776187968.727320:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000028e219af pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659907840:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1776187968.727330:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000001a4e5517/2, rc 0, transno 879 00000100:00100000:1.0:1776187968.727333:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a4e5517 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659907776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.727413:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005bb15d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659909376:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.727449:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.727471:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1776187968.727476:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000871c4100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659909440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.727499:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.727524:0:11826:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659909376 00000100:00100000:1.0:1776187968.727551:0:11826:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659909440 00000100:00100000:1.0:1776187968.727567:0:11826:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2881 00000100:00100000:1.0:1776187968.727571:0:11826:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000493cfb9e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+53:2995:x1862467659909376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.727593:0:11826:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:258 count 1 00010000:00010000:1.0:1776187968.727614:0:11826:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 3/0,1 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727629:0:11826:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a191854e/0x92b1eb87ee41ef71 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2181 expref: 27 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727637:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.727639:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.727641:0:11826:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 4/0,1 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727662:0:11826:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a191854e/0x92b1eb87ee41ef71 lrc: 3/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2181 expref: 27 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727673:0:11826:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a191854e/0x92b1eb87ee41ef71 lrc: 4/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2181 expref: 27 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.727683:0:11826:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0dce98f pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:11826:1862467659909504:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.727726:0:11826:0:(client.c:2500:ptlrpc_set_wait()) set 00000000598bef03 going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.727742:0:11796:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2882 00000100:00100000:1.0:1776187968.727746:0:11796:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000545884de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:2995:x1862467659909440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.727758:0:11796:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:278 count 1 00010000:00010000:1.0:1776187968.727770:0:11796:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 3/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727780:0:11796:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035ee1c84/0x92b1eb87ee420114 lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28b2 expref: 27 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727786:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.727788:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.727789:0:11796:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 4/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727807:0:11796:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035ee1c84/0x92b1eb87ee420114 lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28b2 expref: 27 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.727815:0:11796:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035ee1c84/0x92b1eb87ee420114 lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28b2 expref: 27 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.727823:0:11796:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a01f2b9b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:11796:1862467659909568:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.727846:0:11796:0:(client.c:2500:ptlrpc_set_wait()) set 0000000058534dac going to sleep for 43 seconds 00000004:00080000:1.0:1776187968.727897:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000d74ae161/2, rc 0, transno 878 00000100:00100000:1.0:1776187968.727907:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d74ae161 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659907712:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.727944:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1776187968.727951:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dde06a41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659909632:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.727976:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.728003:0:6329:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659909632 00000100:00100000:1.0:1776187968.728028:0:6329:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2883 00000100:00100000:1.0:1776187968.728032:0:6329:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b876fd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:2994:x1862467659909632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.728045:0:6329:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:239 count 1 00010000:00010000:1.0:1776187968.728058:0:6329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 3/0,1 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.728069:0:6329:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a45ca45/0x92b1eb87ee41dd03 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a26 expref: 27 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.728075:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.728077:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.728079:0:6329:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 4/0,1 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.728098:0:6329:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a45ca45/0x92b1eb87ee41dd03 lrc: 3/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a26 expref: 27 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.728106:0:6329:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a45ca45/0x92b1eb87ee41dd03 lrc: 4/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a26 expref: 27 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.728115:0:6329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8535afd pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6329:1862467659909696:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.728135:0:6329:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d9023075 going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.728156:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427072 00000100:00100000:1.0:1776187968.728195:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15445 00000100:00100000:1.0:1776187968.728200:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081464c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+40:11414:x1862467653427072:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.728357:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081464c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+40:11414:x1862467653427072:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 157us (5755us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.728365:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15445 00000100:00100000:0.0:1776187968.728587:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd82bb7e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:2993:x1862467659907072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 40790us (40972us total) trans 4294968177 rc 0/0 00000100:00100000:0.0:1776187968.728595:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2867 00010000:00010000:0.0:1776187968.728617:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1776187968.728622:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728631:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059094af5 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.728634:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 2/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728653:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 3/0,0 mode: PW/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728673:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 1/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728679:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059094af5/0x92b1eb87ee43a514 lrc: 0/0,0 mode: --/PW res: [0x105:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728701:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1776187968.728705:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728710:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ac819bc1 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.728712:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728718:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 3/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728727:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 1/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728733:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a529 lrc: 0/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728745:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1776187968.728747:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 2/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728753:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b3067c2f already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.728754:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 2/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728759:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 3/0,0 mode: PW/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728772:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 1/0,0 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728778:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3067c2f/0x92b1eb87ee43a51b lrc: 0/0,0 mode: --/PW res: [0x11b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728791:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.728793:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728809:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e5979b39 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.728811:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728816:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 3/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728825:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 1/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728829:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5979b39/0x92b1eb87ee43a522 lrc: 0/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728842:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.728843:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.728844:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.728851:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.728858:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.728913:0:11795:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000989cf477/0x92b1eb87ee41f9ab lrc: 0/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c258d expref: 34 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.728928:0:11795:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db1b501c pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:11795:1862467659908480:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.728949:0:11795:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728957:0:11795:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728964:0:11795:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728972:0:11795:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 3/0,1 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.728979:0:11795:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.729001:0:11795:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.729227:0:11795:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e0ae52a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:2995:x1862467659908288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 34635us (36895us total) trans 4294968211 rc 0/0 00000100:00100000:0.0:1776187968.729234:0:11795:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2872 00000004:00080000:0.0:1776187968.729271:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000083801d1/2, rc 0, transno 915 00000100:00100000:0.0:1776187968.729281:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000083801d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659908288:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1776187968.730547:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.730555:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.730567:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a9283777 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.730570:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 2/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.730577:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 3/0,0 mode: PW/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.730600:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 1/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.730606:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9283777/0x92b1eb87ee43a537 lrc: 0/0,0 mode: --/PW res: [0x10d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.730624:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.730625:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.730626:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.730840:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db1b501c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659909760:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.730910:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.731183:0:11794:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f0afe19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:11794:1862467659908544:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.731205:0:11794:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 3/0,1 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.731234:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659909760 00000100:00100000:0.0:1776187968.731283:0:11795:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2884 00000100:00100000:0.0:1776187968.731289:0:11795:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002381005a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:2994:x1862467659909760:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187968.731442:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00002000:00080000:0.0:1776187968.731928:0:11795:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:275 count 1 00010000:00010000:1.0:1776187968.731948:0:6326:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.731955:0:11795:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 3/0,1 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.731962:0:6326:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.731974:0:6326:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 3/0,1 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.731975:0:11795:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075b886d1/0x92b1eb87ee41fe20 lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2777 expref: 33 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.731992:0:6326:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.731994:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.731996:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.731999:0:11795:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 4/0,1 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.732014:0:6326:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1776187968.732028:0:11795:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075b886d1/0x92b1eb87ee41fe20 lrc: 3/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2777 expref: 33 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.732039:0:11795:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075b886d1/0x92b1eb87ee41fe20 lrc: 4/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2777 expref: 33 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.732050:0:11795:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006f0afe19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:11795:1862467659909824:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.732293:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083a94df2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:2993:x1862467659907008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44901us (45007us total) trans 4294968178 rc 0/0 00000100:00100000:1.0:1776187968.732302:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2865 00000100:00100000:1.0:1776187968.732356:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000979c8d84 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+27:2223:x1862467653426944:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 10759us (11014us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.732368:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4396 00010000:00010000:2.0:1776187968.732407:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.732413:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.732421:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089ca4280 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.732425:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 2/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.732431:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 3/0,0 mode: PW/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.732451:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 1/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.732457:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ca4280/0x92b1eb87ee43a506 lrc: 0/0,0 mode: --/PW res: [0xfc:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.732472:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.732473:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.732474:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.732575:0:11795:0:(client.c:2500:ptlrpc_set_wait()) set 000000002966107a going to sleep for 43 seconds 00000004:00080000:0.0:1776187968.732627:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000089eb1245/2, rc 0, transno 881 00000100:00100000:0.0:1776187968.732946:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089eb1245 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659907072:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1776187968.732966:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000000ee3389a/2, rc 0, transno 914 00000100:00100000:0.0:1776187968.732976:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000ee3389a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659907456:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.733494:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427328 00010000:00010000:1.0:1776187968.733521:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035d95985/0x92b1eb87ee41e808 lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e71 expref: 34 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.733551:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4402 00000100:00100000:1.0:1776187968.733556:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d93a4cc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+34:2225:x1862467653427328:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1776187968.733567:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.733571:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035d95985/0x92b1eb87ee41e808 lrc: 4/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e71 expref: 34 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.733579:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035d95985/0x92b1eb87ee41e808 lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e71 expref: 34 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.733597:0:11830:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035d95985/0x92b1eb87ee41e808 lrc: 0/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1e71 expref: 34 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.733609:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.733611:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.733614:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.733622:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 4/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.733644:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.733675:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d93a4cc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+33:2225:x1862467653427328:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 118us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.733681:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4402 00000100:00100000:0.0:1776187968.735565:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000618c42d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659909888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.735633:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1776187968.735714:0:11794:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.735727:0:11794:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.735737:0:11794:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 3/0,1 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.735744:0:11794:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.735765:0:11794:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.736085:0:11794:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad791b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:2994:x1862467659908160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40645us (41877us total) trans 4294968212 rc 0/0 00000100:00100000:0.0:1776187968.736322:0:11794:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2873 00000100:00100000:0.0:1776187968.736351:0:11794:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659909888 00000100:00100000:0.0:1776187968.736382:0:11794:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2885 00000100:00100000:0.0:1776187968.736388:0:11794:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1ff9cf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:2995:x1862467659909888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.737202:0:11794:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:264 count 1 00010000:00010000:0.0:1776187968.737231:0:11794:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 3/0,1 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.738037:0:11794:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee33e5ec/0x92b1eb87ee41f4b8 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2395 expref: 32 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.738045:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.738048:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.738051:0:11794:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 4/0,1 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.738346:0:11794:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee33e5ec/0x92b1eb87ee41f4b8 lrc: 3/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2395 expref: 32 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.738357:0:11794:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee33e5ec/0x92b1eb87ee41f4b8 lrc: 4/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2395 expref: 32 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.738372:0:11794:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000344f6d72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:11794:1862467659909952:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.738515:0:11794:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f28305b6 going to sleep for 43 seconds 00000004:00080000:0.0:1776187968.738572:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000294394ae/2, rc 0, transno 916 00000100:00100000:0.0:1776187968.738585:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000294394ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659908160:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187968.738619:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.739263:0:11827:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e8f5ee10 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:11827:1862467659908672:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.739283:0:11827:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 3/0,1 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.739327:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.739354:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.739363:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1776187968.739377:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.739388:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a6d022f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659910016:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187968.739404:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427520 00010000:00010000:3.0:1776187968.739430:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000541ec9ed/0x92b1eb87ee41f73c lrc: 5/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2483 expref: 33 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.739456:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427584 00010000:00010000:3.0:1776187968.739467:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c8a5644/0x92b1eb87ee41fcbb lrc: 5/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26dd expref: 34 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.739483:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427648 00010000:00010000:3.0:1776187968.739491:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069741cbe/0x92b1eb87ee41e8cc lrc: 4/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ec5 expref: 35 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.739508:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4403 00000100:00100000:3.0:1776187968.739513:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003060b016 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+35:2225:x1862467653427520:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.739526:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.739531:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000541ec9ed/0x92b1eb87ee41f73c lrc: 5/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2483 expref: 35 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.739540:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000541ec9ed/0x92b1eb87ee41f73c lrc: 4/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2483 expref: 35 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.739564:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.739567:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.739570:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.739579:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 4/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.739596:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1776187968.739598:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.739636:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003060b016 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+35:2225:x1862467653427520:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 121us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.739643:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4403 00000100:00100000:3.0:1776187968.739696:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4404 00000100:00100000:3.0:1776187968.739701:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5b781a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+34:2225:x1862467653427584:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.739708:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.739711:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c8a5644/0x92b1eb87ee41fcbb lrc: 5/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26dd expref: 34 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.739720:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c8a5644/0x92b1eb87ee41fcbb lrc: 4/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26dd expref: 34 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.739744:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.739745:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.739747:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.739754:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 4/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.739766:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.739772:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.739778:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.739787:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5b781a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+34:2225:x1862467653427584:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 82us (430us total) trans 0 rc 0/0 00010000:00010000:0.0:1776187968.739791:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (00000000924fc23c) 00000100:00100000:3.0:1776187968.739796:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4404 00010000:00010000:0.0:1776187968.739797:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 2/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.739810:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4405 00000100:00100000:3.0:1776187968.739814:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009fb7075 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+33:2225:x1862467653427648:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.739821:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.739825:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069741cbe/0x92b1eb87ee41e8cc lrc: 4/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ec5 expref: 33 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.739834:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069741cbe/0x92b1eb87ee41e8cc lrc: 3/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ec5 expref: 33 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.739845:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069741cbe/0x92b1eb87ee41e8cc lrc: 0/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ec5 expref: 33 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.739857:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.739859:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.739861:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.739867:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 4/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.739903:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.739903:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 3/0,0 mode: PW/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.739917:0:11827:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.739919:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 1/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.739936:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a53e lrc: 0/0,0 mode: --/PW res: [0xfa:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.739937:0:11827:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.739956:0:11827:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 3/0,1 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.739961:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.739963:0:11827:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.739964:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.739966:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.739981:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427456 00000100:00100000:0.0:1776187968.740013:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15446 00000100:00100000:0.0:1776187968.740018:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a4a24cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+40:11406:x1862467653427456:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:0.0:1776187968.740070:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1776187968.740146:0:11827:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1776187968.740221:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001342732e/0x92b1eb87ee41d11e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ec:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c15cd expref: 40 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.740245:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f28b491d/0x92b1eb87ee41cd0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ec:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c146f expref: 39 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.740259:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000dd2743b5/0x92b1eb87ee41ce46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ec:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c14e6 expref: 38 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.740272:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000001af368f6/0x92b1eb87ee41ccf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ec:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1468 expref: 37 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.740282:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ec:0x0].0x0 (000000006f988c48) 00010000:00010000:0.0:1776187968.740291:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.740329:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a599 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.740341:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a599 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.740349:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a599 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.740361:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.740368:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.740430:0:11827:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025c71879 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+54:2994:x1862467659908352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43362us (46140us total) trans 4294968213 rc 0/0 00000100:00100000:3.0:1776187968.740438:0:11827:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2875 00000100:00100000:3.0:1776187968.740454:0:11827:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659910016 00000100:00100000:3.0:1776187968.740474:0:11827:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2886 00000100:00100000:3.0:1776187968.740478:0:11827:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000890f1430 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+54:2995:x1862467659910016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1776187968.740493:0:11827:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:276 count 1 00010000:00010000:0.0:1776187968.740504:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.740510:0:11827:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 3/0,1 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.740522:0:11827:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba992c35/0x92b1eb87ee41fee4 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27cb expref: 32 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.740529:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.740531:0:11827:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.740532:0:11827:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 4/0,1 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.740559:0:11827:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba992c35/0x92b1eb87ee41fee4 lrc: 3/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27cb expref: 32 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.740576:0:11827:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba992c35/0x92b1eb87ee41fee4 lrc: 4/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27cb expref: 32 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.740587:0:11827:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e5ee0d2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:11827:1862467659910080:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.740593:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.740603:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.740609:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.740621:0:11827:0:(client.c:2500:ptlrpc_set_wait()) set 00000000c391d1e7 going to sleep for 43 seconds 00000100:00100000:3.0:1776187968.740662:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009fb7075 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+32:2225:x1862467653427648:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 846us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.740668:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4405 00000100:00100000:3.0:1776187968.740860:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.740898:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427776 00010000:00010000:3.0:1776187968.740914:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000063faacd9/0x92b1eb87ee41fd7f lrc: 5/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2731 expref: 32 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.740932:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4406 00000100:00100000:3.0:1776187968.740936:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ba94a74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+32:2224:x1862467653427776:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1776187968.740943:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.740947:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000063faacd9/0x92b1eb87ee41fd7f lrc: 5/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2731 expref: 32 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.740955:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000063faacd9/0x92b1eb87ee41fd7f lrc: 4/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2731 expref: 32 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.741020:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.741022:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.741024:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.741032:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 4/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.741049:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.741070:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ba94a74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+32:2224:x1862467653427776:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 131us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.741075:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4406 00000100:00100000:3.0:1776187968.741124:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.741143:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427840 00000100:00100000:3.0:1776187968.741174:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15447 00000100:00100000:3.0:1776187968.741178:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000942efc84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+37:11414:x1862467653427840:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187968.741347:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000942efc84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+37:11414:x1862467653427840:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 168us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.741354:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15447 00000100:00100000:3.0:1776187968.741496:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.741513:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427904 00010000:00010000:3.0:1776187968.741531:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a4bc40e/0x92b1eb87ee42029c lrc: 5/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2961 expref: 27 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.741554:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4407 00000100:00100000:3.0:1776187968.741558:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007485566e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+27:2224:x1862467653427904:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.741565:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.741568:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a4bc40e/0x92b1eb87ee42029c lrc: 5/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2961 expref: 27 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.741583:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a4bc40e/0x92b1eb87ee42029c lrc: 4/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2961 expref: 27 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.741601:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.741603:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.741604:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.741612:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 4/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.741627:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.741705:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007485566e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+27:2224:x1862467653427904:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 145us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.741712:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4407 00010000:00010000:2.0:1776187968.741759:0:11790:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a4bc40e/0x92b1eb87ee42029c lrc: 0/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2961 expref: 26 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.741775:0:11790:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007b68c7c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:11790:1862467659909056:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.741794:0:11790:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.741958:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.741975:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427968 00010000:00010000:3.0:1776187968.741991:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098280645/0x92b1eb87ee41ffa8 lrc: 5/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c281f expref: 32 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.741994:0:11790:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.742008:0:11790:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.742016:0:11790:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 3/0,1 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.742023:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4408 00010000:00010000:2.0:1776187968.742026:0:11790:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.742032:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fe90f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+32:2224:x1862467653427968:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.742045:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.742049:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098280645/0x92b1eb87ee41ffa8 lrc: 5/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c281f expref: 32 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.742050:0:11790:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1776187968.742065:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098280645/0x92b1eb87ee41ffa8 lrc: 4/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c281f expref: 32 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.742080:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.742082:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.742084:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.742091:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 4/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.742103:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.742119:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fe90f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+32:2224:x1862467653427968:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 89us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.742124:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4408 00010000:00010000:1.0:1776187968.742232:0:11797:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063faacd9/0x92b1eb87ee41fd7f lrc: 0/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2731 expref: 31 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.742244:0:11797:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016e0d7aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:11797:1862467659908928:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.742259:0:11797:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.742266:0:11797:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.742272:0:11797:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187968.742275:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].432, 64 off35904 00010000:00010000:1.0:1776187968.742283:0:11797:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 3/0,1 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.742290:0:11797:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1776187968.742302:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4765, 176 off838232 00010000:00010000:1.0:1776187968.742306:0:11797:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1776187968.742746:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.742760:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.742769:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.742775:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.742780:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.742785:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.742792:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000004:00010000:0.0:1776187968.743056:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008a4a24cf reply state 000000000b5a8587 transno 4294975143 ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.743202:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a599 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.743210:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a599 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.743221:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a599 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.743227:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f73ddd4f already unused, calling callback (000000004eec1e40) 00010000:00010000:0.0:1776187968.743231:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a599 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.743238:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a599 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.743250:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (000000000f84370d) 00010000:00010000:0.0:1776187968.743252:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1776187968.743256:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a599 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.743262:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a599 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1776187968.743277:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000008a4a24cf reply state 000000000b5a8587 transno 4294975143 ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.743425:0:11790:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b0b6bc pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+55:2995:x1862467659908992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36999us (40911us total) trans 4294968179 rc 0/0 00000100:00100000:2.0:1776187968.743435:0:11790:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2878 00000100:00100000:3.0:1776187968.743455:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187968.743469:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1776187968.743475:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.743483:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007dfea8c8 already unused, calling callback (00000000924fc23c) 00000100:00100000:3.0:1776187968.743484:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428032 00010000:00010000:2.0:1776187968.743486:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 2/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.743494:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 3/0,0 mode: PW/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.743508:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001299cda8/0x92b1eb87ee41f162 lrc: 5/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2245 expref: 26 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.743509:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 1/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.743527:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007dfea8c8/0x92b1eb87ee43a54c lrc: 0/0,0 mode: --/PW res: [0xfb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.743548:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4409 00010000:00010000:2.0:1776187968.743549:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1776187968.743553:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.743556:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d93a4cc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+26:2224:x1862467653428032:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1776187968.743567:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c08abd94 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.743570:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 2/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.743573:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.743579:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 3/0,0 mode: PW/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.743580:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001299cda8/0x92b1eb87ee41f162 lrc: 5/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2245 expref: 26 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.743601:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 1/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.743610:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001299cda8/0x92b1eb87ee41f162 lrc: 4/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2245 expref: 26 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.743610:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c08abd94/0x92b1eb87ee43a561 lrc: 0/0,0 mode: --/PW res: [0x118:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.743910:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1776187968.743914:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.743917:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.743920:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.743923:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d26d87db already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.743924:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.743927:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 2/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.743944:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 4/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.743945:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 3/0,0 mode: PW/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.743970:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 1/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.743975:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d26d87db/0x92b1eb87ee43a55a lrc: 0/0,0 mode: --/PW res: [0x112:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.743978:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.743991:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.743994:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.744000:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004e168beb already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.744002:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.744008:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.744009:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d93a4cc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+26:2224:x1862467653428032:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 454us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.744025:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4409 00010000:00010000:2.0:1776187968.744026:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ec:0x0].0x0 (000000007f00126a) 00010000:00010000:2.0:1776187968.744030:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1776187968.744032:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.744038:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000004e168beb/0x92b1eb87ee43a5b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.744048:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.744050:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.744052:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187968.744096:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.744120:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653427712 00010000:00010000:3.0:1776187968.744134:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000895db5b5/0x92b1eb87ee41f090 lrc: 5/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21ea expref: 26 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.744153:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4410 00000100:00100000:3.0:1776187968.744168:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c5d2a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+26:2225:x1862467653427712:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187968.744176:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.744179:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000895db5b5/0x92b1eb87ee41f090 lrc: 5/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21ea expref: 26 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.744192:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000895db5b5/0x92b1eb87ee41f090 lrc: 4/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21ea expref: 26 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.744206:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.744207:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.744209:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.744216:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 4/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.744226:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.744244:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c5d2a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+26:2225:x1862467653427712:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 85us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.744250:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4410 00010000:00010000:2.0:1776187968.744285:0:11818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098280645/0x92b1eb87ee41ffa8 lrc: 0/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c281f expref: 30 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.744299:0:11818:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000946cec49 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:11818:1862467659909312:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.744321:0:11818:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.744329:0:11818:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.744336:0:11818:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.744344:0:11818:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 3/0,1 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.744350:0:11818:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.744366:0:11818:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1776187968.744926:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.744930:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.744939:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009d004fc already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.744942:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 2/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.744949:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 3/0,0 mode: PW/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.744963:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 1/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.744970:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009d004fc/0x92b1eb87ee43a56f lrc: 0/0,0 mode: --/PW res: [0x115:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.744987:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.744989:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.744991:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.745017:0:11818:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012fd664c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+56:2993:x1862467659909248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28688us (31335us total) trans 4294968215 rc 0/0 00000100:00100000:2.0:1776187968.745026:0:11818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2880 00000100:00100000:1.0:1776187968.745271:0:11797:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073816638 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:2993:x1862467659908736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43959us (44612us total) trans 4294968214 rc 0/0 00000100:00100000:1.0:1776187968.745279:0:11797:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2877 00000100:00100000:0.0:1776187968.745285:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a4a24cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+38:11406:x1862467653427456:12345-192.168.204.20@tcp:36:rm.0 Request processed in 5263us (6666us total) trans 4294975143 rc 0/0 00000100:00100000:0.0:1776187968.745295:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15446 00000004:00080000:0.0:1776187968.745348:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000d58dfd0f/2, rc 0, transno 883 00000100:00100000:0.0:1776187968.745364:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d58dfd0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659908992:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.745406:0:11824:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000541ec9ed/0x92b1eb87ee41f73c lrc: 0/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2483 expref: 29 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.745423:0:11824:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e5b78340 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:11824:1862467659908416:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.745440:0:11824:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.745449:0:11824:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.745455:0:11824:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.745461:0:11824:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 3/0,1 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.745468:0:11824:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.745483:0:11824:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.745601:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f0a54e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659910208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.745971:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1776187968.746033:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000cd9a9483/2, rc 0, transno 917 00000100:00100000:0.0:1776187968.746047:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd9a9483 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659908352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.746058:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187968.746062:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000035f62d55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659910144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.746083:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187968.746261:0:11818:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659910208 00000100:00100000:2.0:1776187968.746300:0:11818:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659910144 00000100:00100000:2.0:1776187968.746323:0:11818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2887 00000100:00100000:2.0:1776187968.746330:0:11818:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cc2639a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+56:2994:x1862467659910208:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1776187968.746357:0:11818:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:287 count 1 00000100:00100000:1.0:1776187968.746362:0:11824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b117547 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+55:2995:x1862467659908224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53735us (54779us total) trans 4294968216 rc 0/0 00000100:00100000:1.0:1776187968.746370:0:11824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2871 00010000:00010000:2.0:1776187968.746390:0:11818:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 3/0,1 mode: --/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.746413:0:11818:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3c17d59/0x92b1eb87ee4209fe lrc: 2/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c47 expref: 25 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.746420:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.746423:0:11818:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.746425:0:11818:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 4/0,1 mode: --/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.746450:0:11818:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3c17d59/0x92b1eb87ee4209fe lrc: 3/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c47 expref: 25 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.746460:0:11818:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3c17d59/0x92b1eb87ee4209fe lrc: 4/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c47 expref: 25 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.746470:0:11818:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000946cec49 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:11818:1862467659910336:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.746484:0:11824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2888 00000100:00100000:1.0:1776187968.746490:0:11824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071940cea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+56:2994:x1862467659910144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.746503:0:11824:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:279 count 1 00000100:00100000:2.0:1776187968.746510:0:11818:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ad0b8afb going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.746516:0:11824:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 3/0,1 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.746531:0:11824:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f003170c/0x92b1eb87ee4201d8 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2906 expref: 25 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.746537:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.746544:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.746545:0:11824:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 4/0,1 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.746565:0:11824:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f003170c/0x92b1eb87ee4201d8 lrc: 3/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2906 expref: 25 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.746573:0:11824:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f003170c/0x92b1eb87ee4201d8 lrc: 4/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2906 expref: 25 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.746583:0:11824:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004e3696e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:11824:1862467659910400:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.746607:0:11824:0:(client.c:2500:ptlrpc_set_wait()) set 00000000ae9f50cc going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.746623:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.746633:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.746640:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000474fd8b4 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.746643:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 2/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.746650:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 3/0,0 mode: PW/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.746671:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 1/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.746677:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a530 lrc: 0/0,0 mode: --/PW res: [0x10a:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.746691:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.746692:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.746693:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.746715:0:10783:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000895db5b5/0x92b1eb87ee41f090 lrc: 0/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c21ea expref: 25 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.746724:0:10783:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f692565e pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10783:1862467659908864:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.747058:0:10783:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.747069:0:10783:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.747075:0:10783:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.747083:0:10783:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 3/0,1 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.747090:0:10783:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.747116:0:10783:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187968.747194:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.747198:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.747205:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f0ab918b already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.747207:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 2/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.747213:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 3/0,0 mode: PW/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.747226:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 1/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.747232:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0ab918b/0x92b1eb87ee43a553 lrc: 0/0,0 mode: --/PW res: [0x103:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.747246:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.747248:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.747250:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.747561:0:10783:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000058b4d758 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:2996:x1862467659908800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 46842us (46969us total) trans 4294968180 rc 0/0 00000100:00100000:1.0:1776187968.747571:0:10783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2876 00000100:00100000:0.0:1776187968.747588:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f5b781a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659910272:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1776187968.747596:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.747626:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1776187968.748054:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000cfad8e60/2, rc 0, transno 920 00000100:00100000:0.0:1776187968.748071:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cfad8e60 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659908224:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.748101:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.748278:0:11816:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659910272 00000100:00100000:2.0:1776187968.748316:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2889 00000100:00100000:2.0:1776187968.748321:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030183490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:2995:x1862467659910272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187968.748341:0:11816:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:267 count 1 00010000:00010000:2.0:1776187968.748362:0:11816:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 3/0,1 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.748383:0:11816:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000027e74a5/0x92b1eb87ee41f815 lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24de expref: 28 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.748389:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.748391:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187968.748393:0:11816:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 4/0,1 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.748421:0:9338:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001299cda8/0x92b1eb87ee41f162 lrc: 0/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2245 expref: 24 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.748427:0:11816:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000027e74a5/0x92b1eb87ee41f815 lrc: 3/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24de expref: 28 pid: 11819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.748441:0:9338:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b776bd0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9338:1862467659909184:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.748445:0:11816:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000027e74a5/0x92b1eb87ee41f815 lrc: 4/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24de expref: 28 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.748459:0:9338:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.748463:0:11816:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cdf55e6c pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:11816:1862467659910528:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.748476:0:9338:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.748482:0:9338:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.748490:0:9338:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 3/0,1 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.748497:0:9338:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.748513:0:11816:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d630d36f going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.748516:0:9338:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1776187968.748528:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.748532:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.748538:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4841773 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.748541:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 2/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.748547:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 3/0,0 mode: PW/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.748560:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 1/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.748566:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4841773/0x92b1eb87ee43a568 lrc: 0/0,0 mode: --/PW res: [0x104:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.748579:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.748581:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.748582:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187968.749135:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.749153:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.749195:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.749222:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.749259:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428160 00010000:00010000:3.0:1776187968.749281:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a45ca45/0x92b1eb87ee41dd03 lrc: 5/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a26 expref: 24 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.749302:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428096 00010000:00010000:3.0:1776187968.749311:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a191854e/0x92b1eb87ee41ef71 lrc: 5/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2181 expref: 25 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.749327:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428224 00010000:00010000:3.0:1776187968.749335:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075b886d1/0x92b1eb87ee41fe20 lrc: 5/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2777 expref: 29 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.749346:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428288 00010000:00010000:3.0:1776187968.749354:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee33e5ec/0x92b1eb87ee41f4b8 lrc: 5/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2395 expref: 30 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.749365:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4411 00000100:00100000:3.0:1776187968.749369:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ba94a74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+25:2223:x1862467653428160:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.749379:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.749383:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a45ca45/0x92b1eb87ee41dd03 lrc: 5/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a26 expref: 25 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.749391:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a45ca45/0x92b1eb87ee41dd03 lrc: 4/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a26 expref: 25 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.749408:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.749409:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.749411:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.749420:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 4/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.749435:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.749468:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ba94a74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+25:2223:x1862467653428160:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 97us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.749474:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4411 00000100:00100000:3.0:1776187968.749489:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4412 00000100:00100000:3.0:1776187968.749493:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007485566e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+24:2223:x1862467653428096:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.749499:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.749503:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a191854e/0x92b1eb87ee41ef71 lrc: 5/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2181 expref: 24 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.749511:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a191854e/0x92b1eb87ee41ef71 lrc: 4/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2181 expref: 24 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.749527:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.749529:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.749530:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.749536:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 4/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.749547:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.749562:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007485566e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+24:2223:x1862467653428096:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 68us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.749568:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4412 00000100:00100000:3.0:1776187968.749579:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4413 00000100:00100000:3.0:1776187968.749582:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fe90f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:2223:x1862467653428224:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.749589:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.749592:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075b886d1/0x92b1eb87ee41fe20 lrc: 5/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2777 expref: 30 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.749599:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075b886d1/0x92b1eb87ee41fe20 lrc: 4/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2777 expref: 30 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.749612:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.749614:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.749615:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.749621:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 4/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.749632:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.749658:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fe90f8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:2223:x1862467653428224:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 75us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.749663:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4413 00000100:00100000:3.0:1776187968.749675:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4414 00000100:00100000:3.0:1776187968.749678:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d93a4cc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:2223:x1862467653428288:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187968.749683:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.749686:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee33e5ec/0x92b1eb87ee41f4b8 lrc: 5/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2395 expref: 29 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.749692:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee33e5ec/0x92b1eb87ee41f4b8 lrc: 4/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2395 expref: 29 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.749703:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.749705:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.749706:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.749712:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 4/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.749723:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.749738:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d93a4cc6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:2223:x1862467653428288:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 59us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.749743:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4414 00010000:00010000:2.0:1776187968.750495:0:11826:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a191854e/0x92b1eb87ee41ef71 lrc: 0/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2181 expref: 23 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.750513:0:11826:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0dce98f pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:11826:1862467659909504:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.750532:0:11826:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.750540:0:11826:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.750546:0:11826:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.750554:0:11826:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 3/0,1 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.750560:0:11826:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.750582:0:11826:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1776187968.750896:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.750902:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.750909:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dce30c64 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.750913:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 2/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.750921:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 3/0,0 mode: PW/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.750940:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 1/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.750947:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dce30c64/0x92b1eb87ee43a576 lrc: 0/0,0 mode: --/PW res: [0x102:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.750967:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.750968:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.750970:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.751356:0:11826:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000493cfb9e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+57:2995:x1862467659909376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23781us (23905us total) trans 4294968181 rc 0/0 00000100:00100000:2.0:1776187968.751364:0:11826:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2881 00010000:00010000:1.0:1776187968.751707:0:6329:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a45ca45/0x92b1eb87ee41dd03 lrc: 0/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a26 expref: 22 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.751720:0:6329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8535afd pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6329:1862467659909696:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.751745:0:6329:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.751753:0:6329:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.751763:0:6329:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.751770:0:6329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.751775:0:6329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.751796:0:6329:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187968.751824:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.751829:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.751836:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cea3a6c8 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.751839:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.751846:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 3/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.751860:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 1/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.751866:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cea3a6c8/0x92b1eb87ee43a584 lrc: 0/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.752010:0:6329:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b876fd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:2994:x1862467659909632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23976us (24033us total) trans 4294968182 rc 0/0 00000100:00100000:1.0:1776187968.752019:0:6329:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2883 00000004:00080000:3.0:1776187968.752053:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000dde06a41/2, rc 0, transno 886 00000100:00100000:1.0:1776187968.752058:0:11796:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a01f2b9b pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:11796:1862467659909568:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.752071:0:11796:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 3/0,1 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.752072:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dde06a41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659909632:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1776187968.752763:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.752765:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.752767:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1776187968.753336:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000005bb15d8e/2, rc 0, transno 885 00000100:00100000:0.0:1776187968.753348:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005bb15d8e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659909376:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.753354:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1776187968.753369:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009fb7075 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659910464:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.753428:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1776187968.753488:0:11795:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075b886d1/0x92b1eb87ee41fe20 lrc: 0/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2777 expref: 28 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.753504:0:11795:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006f0afe19 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:11795:1862467659909824:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.753519:0:11795:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.753527:0:11795:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.753538:0:11795:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.753546:0:11795:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 3/0,1 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.753554:0:11795:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.753569:0:11795:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.753785:0:11795:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002381005a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:2994:x1862467659909760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22495us (22875us total) trans 4294968217 rc 0/0 00000100:00100000:0.0:1776187968.753794:0:11795:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2884 00000100:00100000:0.0:1776187968.753829:0:11795:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659910464 00000100:00100000:0.0:1776187968.753860:0:11795:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2890 00000100:00100000:0.0:1776187968.753866:0:11795:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031017d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:2995:x1862467659910464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.753914:0:11795:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:272 count 1 00010000:00010000:0.0:1776187968.753936:0:11795:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 3/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.753952:0:11795:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b76e56e1/0x92b1eb87ee41fbf7 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2689 expref: 27 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.753961:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.753964:0:11795:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.753967:0:11795:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 4/0,1 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754002:0:11795:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b76e56e1/0x92b1eb87ee41fbf7 lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2689 expref: 27 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754014:0:11795:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b76e56e1/0x92b1eb87ee41fbf7 lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2689 expref: 27 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.754025:0:11795:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000138d96d2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:11795:1862467659910720:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.754082:0:11795:0:(client.c:2500:ptlrpc_set_wait()) set 000000006d65048d going to sleep for 43 seconds 00010000:00010000:0.0:1776187968.754108:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.754112:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754119:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.754122:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 2/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754130:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 3/0,0 mode: PW/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754147:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 1/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754153:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a58b lrc: 0/0,0 mode: --/PW res: [0x113:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754182:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.754184:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.754185:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.754213:0:11825:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c8a5644/0x92b1eb87ee41fcbb lrc: 0/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c26dd expref: 27 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.754224:0:11825:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007e46ee9f pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:11825:1862467659908608:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.754235:0:11825:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754242:0:11825:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754247:0:11825:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754253:0:11825:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 3/0,1 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754260:0:11825:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754275:0:11825:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.754559:0:9338:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5db700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:2994:x1862467659909120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 44512us (44624us total) trans 4294968183 rc 0/0 00000100:00100000:1.0:1776187968.754568:0:9338:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2879 00000100:00100000:0.0:1776187968.754654:0:11825:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000249e47c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+57:2994:x1862467659908096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 59082us (60389us total) trans 4294968218 rc 0/0 00000100:00100000:0.0:1776187968.754661:0:11825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2874 00010000:00010000:0.0:1776187968.754678:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.754681:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754692:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.754695:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 2/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754700:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 3/0,0 mode: PW/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754711:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 1/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754716:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f56a3831/0x92b1eb87ee43a545 lrc: 0/0,0 mode: --/PW res: [0x111:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754729:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.754730:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.754731:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.754753:0:11794:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee33e5ec/0x92b1eb87ee41f4b8 lrc: 0/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2395 expref: 26 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.754762:0:11794:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000344f6d72 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:11794:1862467659909952:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.754772:0:11794:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754778:0:11794:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754787:0:11794:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754792:0:11794:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 3/0,1 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754796:0:11794:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.754821:0:11794:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.754970:0:11794:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1ff9cf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:2995:x1862467659909888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18582us (19338us total) trans 4294968219 rc 0/0 00000100:00100000:0.0:1776187968.754978:0:11794:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2885 00000004:00080000:0.0:1776187968.755011:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000618c42d3/2, rc 0, transno 923 00000100:00100000:0.0:1776187968.755021:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000618c42d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659909888:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.755070:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d65b5018 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659910784:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.755095:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.755124:0:11794:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659910784 00000100:00100000:0.0:1776187968.755146:0:11794:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2891 00000100:00100000:0.0:1776187968.755151:0:11794:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000267f7899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+57:2995:x1862467659910784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.755178:0:11794:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:241 count 1 00010000:00010000:0.0:1776187968.755194:0:11794:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 3/0,1 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755206:0:11794:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f9939dc/0x92b1eb87ee41deae lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ac7 expref: 25 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755214:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.755216:0:11794:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.755218:0:11794:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 4/0,1 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755238:0:11794:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f9939dc/0x92b1eb87ee41deae lrc: 3/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ac7 expref: 25 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755248:0:11794:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f9939dc/0x92b1eb87ee41deae lrc: 4/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ac7 expref: 25 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.755258:0:11794:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ef5c0c7d pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:11794:1862467659910848:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.755289:0:11794:0:(client.c:2500:ptlrpc_set_wait()) set 000000008546d52d going to sleep for 43 seconds 00000004:00080000:0.0:1776187968.755332:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000218fbb0b/2, rc 0, transno 884 00000100:00100000:0.0:1776187968.755342:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000218fbb0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659908800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.755382:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1776187968.755388:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007eb3c018 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659910912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.755411:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.755433:0:11829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659910912 00000100:00100000:0.0:1776187968.755455:0:11829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2892 00000100:00100000:0.0:1776187968.755459:0:11829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000783ba691 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+57:2995:x1862467659910912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.755471:0:11829:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:233 count 1 00010000:00010000:0.0:1776187968.755483:0:11829:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 3/0,1 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755494:0:11829:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d3856f6/0x92b1eb87ee41d73e lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17e1 expref: 21 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755500:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.755502:0:11829:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.755503:0:11829:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 4/0,1 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755520:0:11829:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d3856f6/0x92b1eb87ee41d73e lrc: 3/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17e1 expref: 21 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755528:0:11829:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d3856f6/0x92b1eb87ee41d73e lrc: 4/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17e1 expref: 21 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.755538:0:11829:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b84092ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:11829:1862467659910976:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.755561:0:11829:0:(client.c:2500:ptlrpc_set_wait()) set 000000002966107a going to sleep for 43 seconds 00000004:00080000:0.0:1776187968.755586:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000046010e85/2, rc 0, transno 882 00000100:00100000:0.0:1776187968.755595:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000046010e85 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659907008:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.755603:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.755608:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.755617:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000087802dc7 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.755621:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 2/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.755628:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095d509fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659910592:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.755642:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 3/0,0 mode: PW/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.755653:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1776187968.755657:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 1/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.755664:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087802dc7/0x92b1eb87ee43a592 lrc: 0/0,0 mode: --/PW res: [0x108:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1776187968.755675:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000fb87fcf0/2, rc 0, transno 919 00010000:00010000:1.0:1776187968.755682:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.755684:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.755685:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb87fcf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659909248:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1776187968.755687:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.755715:0:11819:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659910592 00000100:00100000:0.0:1776187968.755749:0:11819:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2893 00000100:00100000:0.0:1776187968.755752:0:11819:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb31ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+58:2993:x1862467659910592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.755762:0:11819:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:238 count 1 00010000:00010000:0.0:1776187968.755771:0:11819:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 3/0,1 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755781:0:11819:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d58a0b7/0x92b1eb87ee41dc38 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d2 expref: 21 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755787:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.755788:0:11819:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.755789:0:11819:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 4/0,1 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755804:0:11819:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d58a0b7/0x92b1eb87ee41dc38 lrc: 3/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d2 expref: 21 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.755812:0:11819:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d58a0b7/0x92b1eb87ee41dc38 lrc: 4/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d2 expref: 21 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.755821:0:11819:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd946725 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:11819:1862467659911168:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.755841:0:11819:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a473366e going to sleep for 43 seconds 00000004:00080000:0.0:1776187968.755861:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000001b161714/2, rc 0, transno 918 00000100:00100000:0.0:1776187968.755872:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001b161714 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659908736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.755937:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1776187968.755942:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e88f43fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659911232:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.755964:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.755986:0:11825:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659911232 00000100:00100000:0.0:1776187968.756006:0:11825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2894 00000100:00100000:0.0:1776187968.756010:0:11825:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab63205d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+58:2996:x1862467659911232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.756022:0:11825:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:270 count 1 00010000:00010000:0.0:1776187968.756032:0:11825:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 3/0,1 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.756042:0:11825:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001d7650c7/0x92b1eb87ee41fa92 lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25e8 expref: 25 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.756048:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.756050:0:11825:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.756051:0:11825:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 4/0,1 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.756064:0:11825:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001d7650c7/0x92b1eb87ee41fa92 lrc: 3/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25e8 expref: 25 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.756071:0:11825:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001d7650c7/0x92b1eb87ee41fa92 lrc: 4/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25e8 expref: 25 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.756079:0:11825:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008729ebb9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:11825:1862467659911296:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.756097:0:11825:0:(client.c:2500:ptlrpc_set_wait()) set 00000000994de56e going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.756107:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ead899a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659911040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.756125:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.756147:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1776187968.756152:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b2a2aca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659910656:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.756198:0:6329:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659911040 00000100:00100000:1.0:1776187968.756225:0:6329:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2895 00000100:00100000:1.0:1776187968.756229:0:6329:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e587155 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:2993:x1862467659911040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.756241:0:6329:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:427 count 1 00010000:00010000:1.0:1776187968.756253:0:6329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 3/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.756264:0:6329:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca537dca/0x92b1eb87ee438a48 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8f7 expref: 21 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.756270:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.756272:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.756273:0:6329:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 4/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.756291:0:6329:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca537dca/0x92b1eb87ee438a48 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8f7 expref: 21 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.756311:0:6329:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca537dca/0x92b1eb87ee438a48 lrc: 4/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8f7 expref: 21 pid: 11824 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.756320:0:6329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a01f2b9b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6329:1862467659911360:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.756344:0:6329:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fac0fcfa going to sleep for 43 seconds 00000004:00080000:2.0:1776187968.756955:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000db1b501c/2, rc 0, transno 921 00000100:00100000:2.0:1776187968.756974:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db1b501c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659909760:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1776187968.756987:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000862e5412/2, rc 0, transno 887 00000100:00100000:2.0:1776187968.756998:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000862e5412 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659909120:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1776187968.757012:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000030d971c0/2, rc 0, transno 922 00000100:00100000:2.0:1776187968.757015:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000030d971c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659908096:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.757075:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1776187968.757086:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8535afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659911424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.757119:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.757140:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1776187968.757147:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b776bd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659911488:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.757186:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.757211:0:11826:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659911424 00000100:00100000:1.0:1776187968.757234:0:11826:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659911488 00000100:00100000:1.0:1776187968.757248:0:11826:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2896 00000100:00100000:1.0:1776187968.757251:0:11826:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f692565e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+60:2995:x1862467659911424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.757265:0:11826:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:271 count 1 00010000:00010000:1.0:1776187968.757280:0:11826:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 3/0,1 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.757292:0:11826:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000189134b1/0x92b1eb87ee41fb56 lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c263c expref: 25 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.757311:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.757313:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.757314:0:11826:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 4/0,1 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.757339:0:11826:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000189134b1/0x92b1eb87ee41fb56 lrc: 3/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c263c expref: 25 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.757348:0:11826:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000189134b1/0x92b1eb87ee41fb56 lrc: 4/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c263c expref: 25 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.757358:0:11826:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000016e0d7aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:11826:1862467659911552:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.757385:0:11826:0:(client.c:2500:ptlrpc_set_wait()) set 000000007c5e116f going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.757399:0:10783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2897 00000100:00100000:1.0:1776187968.757403:0:10783:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5b78340 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+60:2994:x1862467659911488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1776187968.757414:0:10783:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:268 count 1 00010000:00010000:1.0:1776187968.757424:0:10783:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 3/0,1 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.757433:0:10783:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003562eb11/0x92b1eb87ee41f8d9 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2532 expref: 25 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.757440:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.757441:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.757443:0:10783:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 4/0,1 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.757457:0:10783:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003562eb11/0x92b1eb87ee41f8d9 lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2532 expref: 25 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.757464:0:10783:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003562eb11/0x92b1eb87ee41f8d9 lrc: 4/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2532 expref: 25 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.757472:0:10783:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be81521 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10783:1862467659911616:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.757490:0:10783:0:(client.c:2500:ptlrpc_set_wait()) set 000000000e3b4515 going to sleep for 43 seconds 00000100:00100000:2.0:1776187968.759195:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000df83f436 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659911680:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1776187968.759254:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187968.759327:0:9338:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659911680 00000100:00100000:1.0:1776187968.759334:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.759368:0:11830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428352 00000100:00100000:3.0:1776187968.759374:0:9338:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2898 00000100:00100000:3.0:1776187968.759382:0:9338:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000013546a3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:2994:x1862467659911680:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.759391:0:11830:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035ee1c84/0x92b1eb87ee420114 lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28b2 expref: 22 pid: 11816 timeout: 545 lvb_type: 0 00002000:00080000:3.0:1776187968.759416:0:9338:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:285 count 1 00000100:00100000:1.0:1776187968.759422:0:11830:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4415 00000100:00100000:1.0:1776187968.759428:0:11830:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1d3e5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+22:2222:x1862467653428352:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.759439:0:9338:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 3/0,1 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.759439:0:11830:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.759445:0:11830:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035ee1c84/0x92b1eb87ee420114 lrc: 4/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28b2 expref: 22 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.759460:0:9338:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c9ee331/0x92b1eb87ee4207ff lrc: 2/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b75 expref: 22 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.759463:0:11830:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035ee1c84/0x92b1eb87ee420114 lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28b2 expref: 22 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.759479:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.759482:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.759484:0:9338:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 4/0,1 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.759497:0:11830:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ee1c84/0x92b1eb87ee420114 lrc: 0/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c28b2 expref: 22 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.759509:0:9338:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c9ee331/0x92b1eb87ee4207ff lrc: 3/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b75 expref: 21 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.759513:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.759516:0:11830:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.759519:0:11830:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.759520:0:9338:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c9ee331/0x92b1eb87ee4207ff lrc: 4/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b75 expref: 21 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.759539:0:11830:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 4/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.759543:0:9338:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000049f832fa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9338:1862467659911744:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.759572:0:11830:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.759588:0:11796:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.759591:0:9338:0:(client.c:2500:ptlrpc_set_wait()) set 000000000638ad3a going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.759599:0:11796:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.759608:0:11796:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 3/0,1 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.759614:0:11796:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.759639:0:11796:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1776187968.759780:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.759785:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.759793:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d719b35a already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.759796:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 2/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.759811:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 3/0,0 mode: PW/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.759825:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 1/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.759835:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d719b35a/0x92b1eb87ee43a57d lrc: 0/0,0 mode: --/PW res: [0x116:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.759851:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.759852:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.759854:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.759907:0:11796:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000545884de pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:2995:x1862467659909440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32158us (32407us total) trans 4294968184 rc 0/0 00000100:00100000:1.0:1776187968.759915:0:11796:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2882 00000100:00100000:0.0:1776187968.760040:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.760063:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005cd1bbde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659911104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.760066:0:11830:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1d3e5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fec2a005-a0e4-4122-9d32-29d5f089fd24+21:2222:x1862467653428352:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 634us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.760076:0:11830:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4415 00000100:00100000:0.0:1776187968.760102:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.760127:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659910656 00000100:00100000:0.0:1776187968.760155:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659911104 00000100:00100000:0.0:1776187968.760184:0:11796:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2899 00000100:00100000:0.0:1776187968.760189:0:11796:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d81b363c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:2993:x1862467659910656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.760205:0:11796:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:237 count 1 00010000:00010000:0.0:1776187968.760219:0:11796:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 3/0,1 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.760228:0:11796:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006523e5de/0x92b1eb87ee41db2e lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c195b expref: 20 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.760235:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.760237:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.760238:0:11796:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 4/0,1 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.760256:0:11796:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006523e5de/0x92b1eb87ee41db2e lrc: 3/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c195b expref: 20 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.760265:0:11796:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006523e5de/0x92b1eb87ee41db2e lrc: 4/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c195b expref: 20 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.760274:0:11796:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080fd36a4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:11796:1862467659911808:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.760301:0:11796:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f8b224a7 going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.760317:0:11790:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2900 00000100:00100000:0.0:1776187968.760321:0:11790:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088bac792 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:2993:x1862467659911104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.760333:0:11790:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:242 count 1 00010000:00010000:0.0:1776187968.760344:0:11790:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 3/0,1 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.760354:0:11790:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000741e047e/0x92b1eb87ee41dfaa lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b29 expref: 25 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.760361:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.760363:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.760364:0:11790:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 4/0,1 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.760385:0:11790:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000741e047e/0x92b1eb87ee41dfaa lrc: 3/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b29 expref: 25 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.760406:0:11790:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000741e047e/0x92b1eb87ee41dfaa lrc: 4/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b29 expref: 25 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.760415:0:11790:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000183af6c5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659911872:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.760451:0:11790:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a8f3b4af going to sleep for 43 seconds 00000004:00080000:3.0:1776187968.760708:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000871c4100/2, rc 0, transno 888 00000100:00100000:3.0:1776187968.760719:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000871c4100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659909440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.761250:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1776187968.761262:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000068f8989e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659911936:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.761302:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.761329:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659911936 00000100:00100000:0.0:1776187968.761362:0:11797:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2901 00000100:00100000:0.0:1776187968.761366:0:11797:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d621e07d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+62:2996:x1862467659911936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.761384:0:11797:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:286 count 1 00010000:00010000:0.0:1776187968.761412:0:11797:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 3/0,1 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.761425:0:11797:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dad242f4/0x92b1eb87ee42092c lrc: 2/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2be5 expref: 20 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.761436:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.761437:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.761438:0:11797:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 4/0,1 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.761457:0:11797:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dad242f4/0x92b1eb87ee42092c lrc: 3/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2be5 expref: 20 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.761467:0:11797:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dad242f4/0x92b1eb87ee42092c lrc: 4/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2be5 expref: 20 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.761476:0:11797:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a3502aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:11797:1862467659912000:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.761501:0:11797:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f28305b6 going to sleep for 43 seconds 00000100:00100000:1.0:1776187968.766003:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.766070:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428416 00000100:00100000:0.0:1776187968.766141:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15448 00000100:00100000:0.0:1776187968.766147:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc603d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+38:11414:x1862467653428416:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187968.766403:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc603d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+38:11414:x1862467653428416:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 254us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.766412:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15448 00010000:00010000:3.0:1776187968.771916:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.771936:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.771945:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.771951:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d042148c already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.771955:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.771963:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.771978:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x3db54834 (00000000298f4138) 00010000:00010000:3.0:1776187968.771981:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.771985:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.771997:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d042148c/0x92b1eb87ee43a5a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ea:0x0].0x3db54834 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.772018:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.772025:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.772030:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.772035:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007072c805 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.772038:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.772043:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.772050:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ec:0x0].0x0 (000000007f00126a) 00010000:00010000:3.0:1776187968.772052:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187968.772054:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.772059:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000007072c805/0x92b1eb87ee43a5ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.772625:0:11827:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e5ee0d2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:11827:1862467659910080:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.772703:0:6329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a01f2b9b pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6329:1862467659911360:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.772725:0:6329:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 3/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.772778:0:11824:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004e3696e7 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:11824:1862467659910400:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.772791:0:11824:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 3/0,1 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.772842:0:11827:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 3/0,1 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.777033:0:11826:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000016e0d7aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:11826:1862467659911552:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.777064:0:11826:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 3/0,1 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.777138:0:10783:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be81521 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10783:1862467659911616:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.777150:0:10783:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 3/0,1 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.777363:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.777398:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.777428:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428544 00010000:00010000:1.0:1776187968.777462:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c17d59/0x92b1eb87ee4209fe lrc: 5/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c47 expref: 21 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.777497:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428672 00010000:00010000:1.0:1776187968.777510:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d3856f6/0x92b1eb87ee41d73e lrc: 5/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17e1 expref: 22 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.777530:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4416 00000100:00100000:1.0:1776187968.777535:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004be81521 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+22:2224:x1862467653428544:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00010000:00010000:1.0:1776187968.777550:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.777554:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3c17d59/0x92b1eb87ee4209fe lrc: 5/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c47 expref: 22 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.777564:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3c17d59/0x92b1eb87ee4209fe lrc: 4/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c47 expref: 22 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.777590:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.777593:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.777596:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 3/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.777605:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 4/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.777918:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.777971:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004be81521 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+22:2224:x1862467653428544:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 434us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.777981:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4416 00000100:00100000:1.0:1776187968.778001:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4417 00000100:00100000:1.0:1776187968.778006:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ae43c2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+21:2222:x1862467653428672:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1776187968.778013:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.778017:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d3856f6/0x92b1eb87ee41d73e lrc: 5/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17e1 expref: 21 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.778026:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d3856f6/0x92b1eb87ee41d73e lrc: 4/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17e1 expref: 21 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.778039:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.778040:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.778042:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.778048:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 4/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.778059:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.778075:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ae43c2f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+21:2222:x1862467653428672:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 69us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.778081:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4417 00000100:00100000:1.0:1776187968.778149:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.778535:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.779417:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.779445:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.779472:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.779495:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.779524:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428800 00010000:00010000:1.0:1776187968.779550:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001d7650c7/0x92b1eb87ee41fa92 lrc: 5/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25e8 expref: 26 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.779572:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428928 00010000:00010000:1.0:1776187968.779580:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000189134b1/0x92b1eb87ee41fb56 lrc: 4/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c263c expref: 27 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.779591:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428608 00010000:00010000:1.0:1776187968.779598:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000027e74a5/0x92b1eb87ee41f815 lrc: 5/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24de expref: 28 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.779608:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428736 00010000:00010000:1.0:1776187968.779615:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d58a0b7/0x92b1eb87ee41dc38 lrc: 5/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d2 expref: 21 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.779624:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428864 00010000:00010000:1.0:1776187968.779646:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca537dca/0x92b1eb87ee438a48 lrc: 4/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8f7 expref: 22 pid: 11824 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.779665:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428992 00010000:00010000:1.0:1776187968.779675:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003562eb11/0x92b1eb87ee41f8d9 lrc: 4/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2532 expref: 29 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.779690:0:11842:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4418 00000100:00100000:1.0:1776187968.779695:0:11842:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1d3e5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:2222:x1862467653428800:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1776187968.779707:0:11842:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.779710:0:11842:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001d7650c7/0x92b1eb87ee41fa92 lrc: 5/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25e8 expref: 29 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.779721:0:11842:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001d7650c7/0x92b1eb87ee41fa92 lrc: 4/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25e8 expref: 29 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.780312:0:11825:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008729ebb9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:11825:1862467659911296:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.780385:0:11816:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cdf55e6c pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:11816:1862467659910528:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.780399:0:11816:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 3/0,1 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.780488:0:11818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c17d59/0x92b1eb87ee4209fe lrc: 0/0,0 mode: --/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c47 expref: 22 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.780503:0:11818:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000946cec49 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:11818:1862467659910336:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.780514:0:11818:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 3/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.780534:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4419 00000100:00100000:3.0:1776187968.780539:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004be81521 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:2222:x1862467653428928:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.780550:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.780565:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000189134b1/0x92b1eb87ee41fb56 lrc: 4/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c263c expref: 29 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.780574:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000189134b1/0x92b1eb87ee41fb56 lrc: 3/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c263c expref: 29 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.780593:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000189134b1/0x92b1eb87ee41fb56 lrc: 0/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c263c expref: 29 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.780603:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.780604:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.780608:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.780616:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 4/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.780746:0:11826:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.780755:0:11826:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.780765:0:11826:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 3/0,1 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.780772:0:11826:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.780791:0:11826:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1776187968.780916:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.781317:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004be81521 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:2222:x1862467653428928:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 776us (2782us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.781326:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4419 00000100:00100000:3.0:1776187968.781353:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4420 00000100:00100000:3.0:1776187968.781357:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016e0d7aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+27:2222:x1862467653428608:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.781366:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.781370:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000027e74a5/0x92b1eb87ee41f815 lrc: 4/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24de expref: 27 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.781417:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000027e74a5/0x92b1eb87ee41f815 lrc: 3/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24de expref: 27 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.781432:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027e74a5/0x92b1eb87ee41f815 lrc: 0/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c24de expref: 27 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.781446:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.781447:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.781449:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.781456:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 4/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.781475:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.781495:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016e0d7aa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+26:2222:x1862467653428608:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 137us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.781503:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4420 00000100:00100000:3.0:1776187968.781516:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4421 00000100:00100000:3.0:1776187968.781521:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a01f2b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+21:2222:x1862467653428736:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.781528:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.781532:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d58a0b7/0x92b1eb87ee41dc38 lrc: 5/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d2 expref: 21 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.781540:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d58a0b7/0x92b1eb87ee41dc38 lrc: 4/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d2 expref: 21 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.781564:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.781566:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.781568:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.781574:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 4/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.781586:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.781601:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a01f2b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+21:2222:x1862467653428736:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 79us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.781606:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4421 00000100:00100000:3.0:1776187968.781618:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4422 00000100:00100000:3.0:1776187968.781622:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ff1b27a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+20:2222:x1862467653428864:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.781629:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.781632:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca537dca/0x92b1eb87ee438a48 lrc: 4/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8f7 expref: 20 pid: 11824 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.782251:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca537dca/0x92b1eb87ee438a48 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8f7 expref: 20 pid: 11824 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.782270:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca537dca/0x92b1eb87ee438a48 lrc: 0/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8f7 expref: 20 pid: 11824 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.782279:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.782281:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.782283:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.782289:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 4/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.782310:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.782334:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ff1b27a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+19:2222:x1862467653428864:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 710us (2861us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.782340:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4422 00000100:00100000:3.0:1776187968.782356:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4423 00000100:00100000:3.0:1776187968.782361:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e3696e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+25:2222:x1862467653428992:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.782370:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.782374:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003562eb11/0x92b1eb87ee41f8d9 lrc: 4/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2532 expref: 25 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.782382:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003562eb11/0x92b1eb87ee41f8d9 lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2532 expref: 25 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.782397:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003562eb11/0x92b1eb87ee41f8d9 lrc: 0/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2532 expref: 25 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.782406:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.782407:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.782409:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.782414:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 4/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.782437:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.782453:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e3696e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+24:2222:x1862467653428992:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 91us (2958us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.782460:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4423 00010000:00010000:3.0:1776187968.782488:0:11816:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.782495:0:11816:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.782503:0:11816:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 3/0,1 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.782509:0:11816:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.782528:0:11816:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1776187968.783051:0:11826:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f692565e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+62:2995:x1862467659911424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25797us (25931us total) trans 4294968220 rc 0/0 00000100:00100000:2.0:1776187968.783060:0:11826:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2896 00000004:00080000:3.0:1776187968.783421:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000a8535afd/2, rc 0, transno 924 00000100:00100000:3.0:1776187968.783446:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8535afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659911424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187968.783538:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030183490 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:2995:x1862467659910272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35216us (35913us total) trans 4294968221 rc 0/0 00000100:00100000:3.0:1776187968.783546:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2889 00000004:00080000:3.0:1776187968.783912:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000f5b781a5/2, rc 0, transno 925 00000100:00100000:3.0:1776187968.783923:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f5b781a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659910272:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187968.783927:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1776187968.783941:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cdf55e6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659912064:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187968.784041:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187968.784332:0:11826:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659912064 00010000:00010000:2.0:1776187968.784438:0:11818:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 3/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.784450:0:11818:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 3/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.784459:0:11818:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 3/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.784465:0:11818:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 2/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.784482:0:11818:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1776187968.785219:0:11826:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2902 00000100:00100000:3.0:1776187968.785226:0:11826:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e5ee0d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+62:2995:x1862467659912064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1776187968.785257:0:11826:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:239 count 1 00000100:00100000:2.0:1776187968.785411:0:11818:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cc2639a pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+63:2994:x1862467659910208:12345-0@lo:6:osp-syn-0-0.0 Request processed in 39080us (39441us total) trans 4294968185 rc 0/0 00000100:00100000:2.0:1776187968.785419:0:11818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2887 00010000:00010000:3.0:1776187968.785570:0:11826:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 3/0,1 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.785588:0:11826:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb06b321/0x92b1eb87ee41dc46 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d9 expref: 23 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.785594:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.785596:0:11826:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187968.785598:0:11826:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 4/0,1 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.785634:0:11826:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bb06b321/0x92b1eb87ee41dc46 lrc: 3/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d9 expref: 23 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.785775:0:11826:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bb06b321/0x92b1eb87ee41dc46 lrc: 4/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d9 expref: 23 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.785789:0:11826:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074844faf pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:11826:1862467659912192:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187968.786070:0:11826:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b5d4ad70 going to sleep for 43 seconds 00010000:00010000:3.0:1776187968.786170:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1776187968.786175:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786184:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000550d135e already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.786188:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 2/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786196:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 3/0,0 mode: PW/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786215:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 1/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786222:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000550d135e/0x92b1eb87ee43a5fb lrc: 0/0,0 mode: --/PW res: [0x10f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786236:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1776187968.786239:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786244:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000791f3e8c already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.786246:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 2/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786252:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 3/0,0 mode: PW/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786268:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 1/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786273:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000791f3e8c/0x92b1eb87ee43a5ca lrc: 0/0,0 mode: --/PW res: [0x10b:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786286:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.786294:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 2/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786299:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d81ab485 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.786301:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 2/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786307:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 3/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786316:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 1/0,0 mode: --/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786325:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d81ab485/0x92b1eb87ee43a5bc lrc: 0/0,0 mode: --/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786338:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.786339:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.786341:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.786439:0:10783:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.786447:0:10783:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.786455:0:10783:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 3/0,1 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.786461:0:10783:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.786481:0:10783:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1776187968.786529:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.786531:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786537:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4cacb49 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.786539:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 2/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786545:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 3/0,0 mode: PW/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786908:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 1/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786917:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4cacb49/0x92b1eb87ee43a602 lrc: 0/0,0 mode: --/PW res: [0x10c:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.786929:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.786931:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.786932:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.787246:0:11825:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 3/0,1 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.787263:0:11842:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d7650c7/0x92b1eb87ee41fa92 lrc: 0/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c25e8 expref: 23 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.787278:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.787281:0:11842:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.787284:0:11842:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.787293:0:11842:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 4/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1776187968.787298:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000f0a54e30/2, rc 0, transno 889 00010000:00010000:1.0:1776187968.787313:0:11842:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187968.787321:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f0a54e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659910208:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.787329:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187968.787345:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fa12d7bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659912128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.787355:0:11842:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1d3e5b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+22:2222:x1862467653428800:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 7657us (9205us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.787366:0:11842:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4418 00000100:00100000:0.0:1776187968.787391:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187968.787420:0:11816:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659912128 00010000:00010000:0.0:1776187968.787425:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.787448:0:11819:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d58a0b7/0x92b1eb87ee41dc38 lrc: 0/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d2 expref: 18 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.787457:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2903 00000100:00100000:0.0:1776187968.787464:0:11819:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd946725 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:11819:1862467659911168:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.787465:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f1d31b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+64:2994:x1862467659912128:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.787482:0:11819:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.787490:0:11819:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.787495:0:11819:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.787502:0:11819:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.787507:0:11819:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.787533:0:11819:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1776187968.787604:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.787607:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.787615:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000004a152635 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.787617:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.787623:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 3/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.787635:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 1/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.787640:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a152635/0x92b1eb87ee43a5e6 lrc: 0/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.787651:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.787652:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.787653:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.787916:0:10783:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5b78340 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+64:2994:x1862467659911488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30511us (30729us total) trans 4294968222 rc 0/0 00000100:00100000:2.0:1776187968.787923:0:10783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2897 00010000:00010000:2.0:1776187968.787941:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.788189:0:6329:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.788198:0:6329:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.788205:0:6329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.788210:0:6329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.788228:0:6329:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187968.788398:0:6329:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e587155 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:2993:x1862467659911040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32167us (32271us total) trans 4294968186 rc 0/0 00000100:00100000:2.0:1776187968.788404:0:6329:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2895 00000100:00100000:3.0:1776187968.788778:0:9338:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000049f832fa pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9338:1862467659911744:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.788797:0:9338:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 3/0,1 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.789051:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.789232:0:11796:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080fd36a4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:11796:1862467659911808:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.789248:0:11796:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 3/0,1 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.789434:0:11819:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb31ea2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+63:2993:x1862467659910592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33677us (33778us total) trans 4294968187 rc 0/0 00000100:00100000:0.0:1776187968.789442:0:11819:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2893 00000100:00100000:0.0:1776187968.789483:0:11797:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a3502aa pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:11797:1862467659912000:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.789494:0:11797:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 3/0,1 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.789522:0:11790:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000183af6c5 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659911872:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.789535:0:11790:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 3/0,1 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.789559:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009ee57b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659912256:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.789626:0:11816:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:285 count 1 00010000:00010000:1.0:1776187968.789658:0:11816:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 3/0,1 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.789677:0:11816:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e402b377/0x92b1eb87ee42068c lrc: 2/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2af7 expref: 21 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.789685:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.789686:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.789688:0:11816:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 4/0,1 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.789715:0:11816:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e402b377/0x92b1eb87ee42068c lrc: 3/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2af7 expref: 21 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.789725:0:11816:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e402b377/0x92b1eb87ee42068c lrc: 4/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2af7 expref: 21 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.789741:0:11816:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0dce98f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:11816:1862467659912320:192.168.204.20@tcp:104: 00000100:00100000:1.0:1776187968.789791:0:11816:0:(client.c:2500:ptlrpc_set_wait()) set 000000007c5e116f going to sleep for 43 seconds 00000100:00100000:2.0:1776187968.790067:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.790231:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1776187968.790261:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000005b776bd0/2, rc 0, transno 926 00000100:00100000:0.0:1776187968.790275:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b776bd0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659911488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.790344:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a3502aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659912384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187968.790369:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1776187968.790397:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.790403:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.790413:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000dd5541f4 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.790416:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.790425:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.790443:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 1/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.790450:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd5541f4/0x92b1eb87ee43a5f4 lrc: 0/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.790469:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.790470:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.790472:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.790530:0:11842:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429120 00010000:00010000:1.0:1776187968.790556:0:11842:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f9939dc/0x92b1eb87ee41deae lrc: 5/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ac7 expref: 22 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.790588:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429248 00010000:00010000:1.0:1776187968.790600:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006523e5de/0x92b1eb87ee41db2e lrc: 4/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c195b expref: 18 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.790615:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4424 00000100:00100000:1.0:1776187968.790622:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091af14f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+22:2223:x1862467653429120:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1776187968.790635:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.790650:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f9939dc/0x92b1eb87ee41deae lrc: 5/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ac7 expref: 22 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.790659:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f9939dc/0x92b1eb87ee41deae lrc: 4/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ac7 expref: 22 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.790674:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.790676:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.790679:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.790688:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 4/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.790703:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.790728:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091af14f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+22:2223:x1862467653429120:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 104us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.790737:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4424 00000100:00100000:1.0:1776187968.790950:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4425 00000100:00100000:1.0:1776187968.790959:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b9316eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:2223:x1862467653429248:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1776187968.790968:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.790972:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006523e5de/0x92b1eb87ee41db2e lrc: 4/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c195b expref: 18 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.790981:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006523e5de/0x92b1eb87ee41db2e lrc: 3/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c195b expref: 18 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.790998:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006523e5de/0x92b1eb87ee41db2e lrc: 0/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c195b expref: 18 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.791007:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.791008:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.791010:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.791016:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 4/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.791034:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1776187968.791050:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b9316eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+17:2223:x1862467653429248:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 95us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.791056:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4425 00010000:00010000:1.0:1776187968.791075:0:11796:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.791082:0:11796:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.791253:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.791283:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.791307:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.791320:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.791331:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.791344:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.791369:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.791441:0:6329:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659912256 00000100:00100000:0.0:1776187968.791477:0:6329:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659912384 00000100:00100000:0.0:1776187968.791493:0:6329:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2904 00010000:00010000:1.0:1776187968.791519:0:11796:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 3/0,1 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.791530:0:11796:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.791553:0:11796:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.791780:0:6329:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000183af6c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:2994:x1862467659912256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.791904:0:6329:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:235 count 1 00010000:00010000:0.0:1776187968.791924:0:6329:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 3/0,1 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.791937:0:6329:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064a9183f/0x92b1eb87ee41d887 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c186d expref: 16 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.791949:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.791950:0:6329:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.791952:0:6329:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 4/0,1 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.791977:0:6329:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064a9183f/0x92b1eb87ee41d887 lrc: 3/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c186d expref: 16 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.791988:0:6329:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064a9183f/0x92b1eb87ee41d887 lrc: 4/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c186d expref: 16 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.791999:0:6329:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd946725 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6329:1862467659912448:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.792038:0:6329:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a8f3b4af going to sleep for 43 seconds 00000100:00100000:0.0:1776187968.792058:0:10783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2905 00000100:00100000:0.0:1776187968.792062:0:10783:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+64:2995:x1862467659912384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1776187968.792075:0:10783:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:286 count 1 00000100:00100000:2.0:1776187968.792239:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.792282:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429440 00000100:00100000:2.0:1776187968.792307:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429632 00000100:00100000:2.0:1776187968.792322:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15449 00000100:00100000:2.0:1776187968.792325:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008256682a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+38:11414:x1862467653429440:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.792507:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008256682a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+38:11414:x1862467653429440:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 180us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.792515:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15449 00000100:00100000:2.0:1776187968.792533:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15450 00000100:00100000:2.0:1776187968.792536:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000092e338f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+37:11406:x1862467653429632:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187968.792571:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1776187968.792589:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000cd0e35a2/0x92b1eb87ee41d2ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ee:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1660 expref: 37 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.792610:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000050da96a4/0x92b1eb87ee41cfb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ee:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1556 expref: 36 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.792620:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d8946dec/0x92b1eb87ee41d301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ee:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1667 expref: 35 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.792630:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b8d6ab27/0x92b1eb87ee41cfa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ee:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c154f expref: 34 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.792639:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ee:0x0].0x0 (000000002eb80cef) 00000100:00100000:1.0:1776187968.793021:0:11796:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d81b363c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:2993:x1862467659910656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 32830us (32981us total) trans 4294968188 rc 0/0 00000100:00100000:1.0:1776187968.793028:0:11796:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2899 00010000:00010000:1.0:1776187968.793051:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.793055:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.793062:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092f8fdca already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.793065:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 2/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.793073:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 3/0,0 mode: PW/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.793088:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 1/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.793093:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092f8fdca/0x92b1eb87ee43a610 lrc: 0/0,0 mode: --/PW res: [0xed:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.793202:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.793203:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.793204:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.793224:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429376 00010000:00010000:1.0:1776187968.793244:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dad242f4/0x92b1eb87ee42092c lrc: 4/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2be5 expref: 17 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.793267:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429056 00010000:00010000:1.0:1776187968.793276:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b76e56e1/0x92b1eb87ee41fbf7 lrc: 5/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2689 expref: 22 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.793292:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429184 00010000:00010000:1.0:1776187968.793299:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c9ee331/0x92b1eb87ee4207ff lrc: 4/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b75 expref: 18 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.793310:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429312 00010000:00010000:1.0:1776187968.793319:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000741e047e/0x92b1eb87ee41dfaa lrc: 4/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b29 expref: 23 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.793329:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653428480 00010000:00010000:1.0:1776187968.793338:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba992c35/0x92b1eb87ee41fee4 lrc: 4/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27cb expref: 24 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.793349:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429504 00010000:00010000:1.0:1776187968.793357:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f003170c/0x92b1eb87ee4201d8 lrc: 4/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2906 expref: 19 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.793369:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4426 00000100:00100000:1.0:1776187968.793373:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000946cec49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+19:2223:x1862467653429376:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1776187968.793406:0:10783:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 3/0,1 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.793720:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4427 00000100:00100000:3.0:1776187968.793726:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6f393cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+24:2223:x1862467653429056:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.793738:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.793742:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b76e56e1/0x92b1eb87ee41fbf7 lrc: 5/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2689 expref: 24 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.793952:0:10783:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4c98993/0x92b1eb87ee42085a lrc: 2/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b98 expref: 24 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.793962:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.793964:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.793966:0:10783:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 4/0,1 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.794006:0:10783:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4c98993/0x92b1eb87ee42085a lrc: 3/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b98 expref: 24 pid: 11819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.794016:0:10783:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4c98993/0x92b1eb87ee42085a lrc: 4/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b98 expref: 24 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.794027:0:10783:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008729ebb9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10783:1862467659912512:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187968.794076:0:10783:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f28305b6 going to sleep for 43 seconds 00010000:00010000:1.0:1776187968.794216:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1776187968.794220:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dad242f4/0x92b1eb87ee42092c lrc: 4/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2be5 expref: 19 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794299:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b76e56e1/0x92b1eb87ee41fbf7 lrc: 4/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2689 expref: 24 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794318:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.794320:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.794323:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.794330:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 4/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.794348:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.794374:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6f393cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+24:2223:x1862467653429056:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 648us (3091us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.794383:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4427 00000100:00100000:3.0:1776187968.794408:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4428 00000100:00100000:3.0:1776187968.794413:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085fc26ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+19:2223:x1862467653429184:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.794423:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.794427:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c9ee331/0x92b1eb87ee4207ff lrc: 4/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b75 expref: 19 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794436:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c9ee331/0x92b1eb87ee4207ff lrc: 3/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b75 expref: 19 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794453:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c9ee331/0x92b1eb87ee4207ff lrc: 0/0,0 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b75 expref: 19 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794465:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.794467:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.794469:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 3/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.794475:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 4/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.794500:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.794517:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085fc26ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:2223:x1862467653429184:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 100us (3207us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.794524:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4428 00000100:00100000:3.0:1776187968.794535:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4429 00000100:00100000:3.0:1776187968.794540:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7a98837 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+23:2223:x1862467653429312:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187968.794546:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.794550:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000741e047e/0x92b1eb87ee41dfaa lrc: 4/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b29 expref: 23 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794558:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000741e047e/0x92b1eb87ee41dfaa lrc: 3/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b29 expref: 23 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794570:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000741e047e/0x92b1eb87ee41dfaa lrc: 0/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1b29 expref: 23 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794578:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.794580:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.794581:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.794587:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 4/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.794606:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.794621:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7a98837 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+22:2223:x1862467653429312:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 81us (3301us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.794627:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4429 00000100:00100000:3.0:1776187968.794639:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4430 00000100:00100000:3.0:1776187968.794654:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db84b536 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+21:2224:x1862467653428480:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1776187968.794661:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.794665:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba992c35/0x92b1eb87ee41fee4 lrc: 4/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27cb expref: 21 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794675:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba992c35/0x92b1eb87ee41fee4 lrc: 3/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27cb expref: 21 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794689:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba992c35/0x92b1eb87ee41fee4 lrc: 0/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c27cb expref: 21 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794702:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.794704:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.794706:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.794712:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 4/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.794727:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.794743:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db84b536 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+20:2224:x1862467653428480:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 88us (3411us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.794748:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4430 00000100:00100000:3.0:1776187968.794759:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4431 00000100:00100000:3.0:1776187968.794763:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000092f793ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+17:2225:x1862467653429504:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1776187968.794770:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.794773:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f003170c/0x92b1eb87ee4201d8 lrc: 4/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2906 expref: 17 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794781:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f003170c/0x92b1eb87ee4201d8 lrc: 3/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2906 expref: 17 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.794791:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f003170c/0x92b1eb87ee4201d8 lrc: 0/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2906 expref: 17 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:0.0:1776187968.794996:0:11795:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b76e56e1/0x92b1eb87ee41fbf7 lrc: 0/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2689 expref: 19 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.795007:0:11795:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000138d96d2 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:11795:1862467659910720:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.795028:0:11795:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.795038:0:11795:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.795044:0:11795:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.795053:0:11795:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 3/0,1 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.795059:0:11795:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.795086:0:11795:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187968.795242:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ac93124e/0x92b1eb87ee420ece lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ed:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2deb expref: 33 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.795253:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ed:0x0].0x0 (00000000434f82b1) 00010000:00010000:2.0:1776187968.795256:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.795275:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.795279:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.795286:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b23405f4 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.795289:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 2/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.795296:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 3/0,0 mode: PW/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.795312:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 1/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.795319:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b23405f4/0x92b1eb87ee43a5d1 lrc: 0/0,0 mode: --/PW res: [0x110:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11795 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.795334:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.795335:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.795336:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.795515:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.795594:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429696 00010000:00010000:2.0:1776187968.795613:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bb06b321/0x92b1eb87ee41dc46 lrc: 5/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d9 expref: 19 pid: 11816 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.795636:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4432 00000100:00100000:2.0:1776187968.795653:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070dcc367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+19:2225:x1862467653429696:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1776187968.795662:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.795664:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bb06b321/0x92b1eb87ee41dc46 lrc: 5/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d9 expref: 19 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.795672:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bb06b321/0x92b1eb87ee41dc46 lrc: 4/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d9 expref: 19 pid: 11816 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.795686:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.795687:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.795690:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.795702:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 4/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.795715:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.795743:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070dcc367 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+19:2225:x1862467653429696:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 102us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.795750:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4432 00010000:00010000:1.0:1776187968.795913:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dad242f4/0x92b1eb87ee42092c lrc: 3/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2be5 expref: 16 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.795929:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dad242f4/0x92b1eb87ee42092c lrc: 0/0,0 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2be5 expref: 16 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:1.0:1776187968.795939:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.795941:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1776187968.795943:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 3/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.795948:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 4/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.795971:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1776187968.795984:0:11797:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 3/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.795992:0:11797:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 3/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.795999:0:11797:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 3/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.796005:0:11797:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 2/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.796022:0:11797:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.796772:0:11795:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031017d0d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+65:2995:x1862467659910464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 42904us (43343us total) trans 4294968223 rc 0/0 00000100:00100000:0.0:1776187968.796782:0:11795:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2890 00000100:00100000:1.0:1776187968.797044:0:11797:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d621e07d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+64:2996:x1862467659911936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35676us (35742us total) trans 4294968189 rc 0/0 00000100:00100000:1.0:1776187968.797052:0:11797:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2901 00010000:00010000:1.0:1776187968.797075:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.797079:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 2/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.797436:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.797440:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.797444:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.797455:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 4/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.797482:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.797519:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000092f793ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+15:2225:x1862467653429504:12345-192.168.204.20@tcp:103:ldlm_bl_04.0 Request processed in 2754us (6150us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.797527:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4431 00010000:00010000:3.0:1776187968.797554:0:11827:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.797564:0:11827:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.797572:0:11827:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 3/0,1 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.797578:0:11827:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.797593:0:11827:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1776187968.797751:0:11827:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000890f1430 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+65:2995:x1862467659910016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 57272us (58156us total) trans 4294968224 rc 0/0 00000100:00100000:3.0:1776187968.797758:0:11827:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2886 00010000:00010000:1.0:1776187968.798493:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d612a45d already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.798498:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 2/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.798509:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 3/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.798526:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 1/0,0 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.798532:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d612a45d/0x92b1eb87ee43a61e lrc: 0/0,0 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.798552:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.798555:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.798561:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000056c4f2e0 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.798563:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 2/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.798568:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 3/0,0 mode: PW/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.798578:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 1/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.798584:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056c4f2e0/0x92b1eb87ee43a5a7 lrc: 0/0,0 mode: --/PW res: [0x114:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11827 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.798595:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.798597:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.798598:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.798606:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.798896:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000946cec49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+14:2223:x1862467653429376:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 5264us (7387us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.798906:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4426 00010000:00010000:2.0:1776187968.799199:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a641 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.799217:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a641 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.799227:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a641 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.799243:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.799249:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.799255:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.799552:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.799560:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.799568:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.799795:0:11826:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb06b321/0x92b1eb87ee41dc46 lrc: 0/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c19d9 expref: 18 pid: 11816 timeout: 545 lvb_type: 0 00000004:00080000:0.0:1776187968.800280:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000009fb7075/2, rc 0, transno 927 00000100:00100000:0.0:1776187968.800303:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009fb7075 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659910464:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1776187968.800317:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000005a6d022f/2, rc 0, transno 928 00000100:00100000:0.0:1776187968.800320:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a6d022f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659910016:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.800343:0:11824:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.800350:0:11824:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.800358:0:11824:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 3/0,1 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.800364:0:11824:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.800386:0:11824:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.800618:0:11824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071940cea pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+64:2994:x1862467659910144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 54126us (54533us total) trans 4294968190 rc 0/0 00000100:00100000:0.0:1776187968.800626:0:11824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2888 00000100:00100000:3.0:1776187968.800846:0:11826:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074844faf pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:11826:1862467659912192:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187968.800867:0:11826:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.800895:0:11826:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.800901:0:11826:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.800907:0:11826:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 3/0,1 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.800912:0:11826:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.800926:0:11826:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1776187968.801072:0:11826:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e5ee0d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+65:2995:x1862467659912064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15846us (17031us total) trans 4294968225 rc 0/0 00000100:00100000:3.0:1776187968.801079:0:11826:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2902 00010000:00010000:3.0:1776187968.801111:0:11790:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.801118:0:11790:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.801130:0:11790:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 3/0,1 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.801135:0:11790:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.801145:0:11790:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1776187968.801254:0:11790:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088bac792 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:2993:x1862467659911104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 40932us (41165us total) trans 4294968226 rc 0/0 00000100:00100000:3.0:1776187968.801260:0:11790:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2900 00000100:00100000:3.0:1776187968.801417:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.801433:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.801461:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.801484:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429888 00000100:00100000:3.0:1776187968.801511:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15451 00000100:00100000:3.0:1776187968.801517:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000668f2aeb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+33:11414:x1862467653429888:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187968.801677:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000668f2aeb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+33:11414:x1862467653429888:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 159us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.801685:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15451 00000100:00100000:3.0:1776187968.801716:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.801765:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429824 00010000:00010000:3.0:1776187968.801781:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e402b377/0x92b1eb87ee42068c lrc: 5/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2af7 expref: 18 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.801802:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429760 00010000:00010000:3.0:1776187968.801811:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064a9183f/0x92b1eb87ee41d887 lrc: 5/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c186d expref: 14 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.801820:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653429952 00010000:00010000:3.0:1776187968.801827:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4c98993/0x92b1eb87ee42085a lrc: 5/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b98 expref: 19 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:3.0:1776187968.801838:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4433 00000100:00100000:3.0:1776187968.801842:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074844faf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+19:2224:x1862467653429824:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187968.801850:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.801854:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e402b377/0x92b1eb87ee42068c lrc: 5/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2af7 expref: 19 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.801864:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e402b377/0x92b1eb87ee42068c lrc: 4/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2af7 expref: 19 pid: 11794 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.801915:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.801918:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.801921:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 3/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.801929:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 4/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.801946:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.801967:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074844faf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+19:2224:x1862467653429824:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 125us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.801973:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4433 00000100:00100000:3.0:1776187968.801985:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4434 00000100:00100000:3.0:1776187968.801988:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049f832fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+14:2224:x1862467653429760:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187968.801994:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.801997:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064a9183f/0x92b1eb87ee41d887 lrc: 5/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c186d expref: 14 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.802005:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064a9183f/0x92b1eb87ee41d887 lrc: 4/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c186d expref: 14 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.802018:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.802019:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.802021:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.802027:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 4/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.802036:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.802048:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049f832fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+14:2224:x1862467653429760:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 59us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.802052:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4434 00000100:00100000:3.0:1776187968.802061:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4435 00000100:00100000:3.0:1776187968.802064:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008fab1ad5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:2224:x1862467653429952:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187968.802069:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187968.802072:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4c98993/0x92b1eb87ee42085a lrc: 5/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b98 expref: 18 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.802085:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4c98993/0x92b1eb87ee42085a lrc: 4/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b98 expref: 18 pid: 11819 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.802094:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.802095:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.802097:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 3/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.802103:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 4/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.802112:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187968.802122:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008fab1ad5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:2224:x1862467653429952:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 57us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.802127:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4435 00010000:00010000:3.0:1776187968.802201:0:9338:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 3/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.802209:0:9338:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 3/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.802217:0:9338:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 3/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.802224:0:9338:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 2/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.802237:0:9338:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1776187968.802410:0:9338:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000013546a3c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:2994:x1862467659911680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 43029us (43158us total) trans 4294968191 rc 0/0 00000100:00100000:3.0:1776187968.802417:0:9338:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2898 00010000:00010000:1.0:1776187968.802671:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1776187968.802676:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802684:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000ea47fb5 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.802688:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 2/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802695:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 3/0,0 mode: PW/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802713:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 1/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802719:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a5c3 lrc: 0/0,0 mode: --/PW res: [0x117:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802734:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1776187968.802736:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802741:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000005bf1cdd already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.802743:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 2/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802748:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 3/0,0 mode: PW/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802756:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 1/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802760:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005bf1cdd/0x92b1eb87ee43a625 lrc: 0/0,0 mode: --/PW res: [0xef:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11826 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802772:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1776187968.802774:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802784:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000059094af5 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.802786:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 2/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802790:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 3/0,0 mode: PW/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802808:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 1/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802813:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059094af5/0x92b1eb87ee43a617 lrc: 0/0,0 mode: --/PW res: [0xf2:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802823:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.802824:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 2/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802830:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ac819bc1 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.802832:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 2/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802837:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 3/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802843:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 1/0,0 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802853:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac819bc1/0x92b1eb87ee43a609 lrc: 0/0,0 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802862:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.802863:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.802865:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.802871:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.802923:0:11816:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e402b377/0x92b1eb87ee42068c lrc: 0/0,0 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2af7 expref: 17 pid: 11794 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.802932:0:11816:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0dce98f pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:11816:1862467659912320:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.802950:0:11816:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 3/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802956:0:11816:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 3/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802961:0:11816:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 3/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802968:0:11816:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 3/0,1 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802974:0:11816:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 2/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.802992:0:11816:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.803200:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f1d31b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+65:2994:x1862467659912128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15735us (15812us total) trans 4294968227 rc 0/0 00000100:00100000:1.0:1776187968.803206:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2903 00010000:00010000:2.0:1776187968.803525:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.803530:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 2/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.803538:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d4841773 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.803541:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 2/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.803548:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 3/0,0 mode: PW/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.803562:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 1/0,0 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.803568:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4841773/0x92b1eb87ee43a62c lrc: 0/0,0 mode: --/PW res: [0x11d:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.803582:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.803583:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.803584:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1776187968.804002:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].431, 64 off35840 00000040:00080000:2.0:1776187968.804023:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4766, 184 off838416 00010000:00010000:2.0:1776187968.804315:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804336:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804347:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804355:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804360:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804366:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804384:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187968.804404:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000092e338f reply state 0000000075d0d805 transno 4294975144 ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804451:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a641 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804457:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a641 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804463:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a641 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804468:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.804471:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a641 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804477:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a641 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804487:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ed:0x0].0x0 (00000000434f82b1) 00010000:00010000:2.0:1776187968.804489:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.804492:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a641 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.804497:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a641 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187968.804505:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000092e338f reply state 0000000075d0d805 transno 4294975144 ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.804586:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000092e338f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+34:11406:x1862467653429632:12345-192.168.204.20@tcp:36:rm.0 Request processed in 12045us (12345us total) trans 4294975144 rc 0/0 00000100:00100000:2.0:1776187968.804594:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15450 00000004:00080000:0.0:1776187968.804782:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000cdf55e6c/2, rc 0, transno 929 00000100:00100000:0.0:1776187968.804794:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cdf55e6c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659912064:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.804837:0:10783:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4c98993/0x92b1eb87ee42085a lrc: 0/0,0 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2b98 expref: 16 pid: 11819 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.804848:0:10783:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008729ebb9 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10783:1862467659912512:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.804865:0:10783:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 3/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.804889:0:10783:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 3/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.804895:0:10783:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 3/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.804902:0:10783:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 3/0,1 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.804907:0:10783:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 2/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.804928:0:10783:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1776187968.805218:0:10783:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080fd36a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+65:2995:x1862467659912384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13153us (14848us total) trans 4294968228 rc 0/0 00000100:00100000:0.0:1776187968.805226:0:10783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2905 00000004:00080000:0.0:1776187968.805254:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000001a3502aa/2, rc 0, transno 932 00000100:00100000:0.0:1776187968.805258:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a3502aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659912384:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1776187968.805278:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000fa12d7bd/2, rc 0, transno 931 00000100:00100000:0.0:1776187968.805282:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fa12d7bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659912128:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1776187968.805292:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000df83f436/2, rc 0, transno 895 00000100:00100000:0.0:1776187968.805303:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000df83f436 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659911680:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1776187968.805312:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000035f62d55/2, rc 0, transno 894 00000100:00100000:0.0:1776187968.805314:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000035f62d55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659910144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.805418:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1776187968.805431:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008729ebb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659912576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.805467:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187968.805495:0:10783:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659912576 00000100:00100000:0.0:1776187968.805521:0:10783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2906 00000100:00100000:0.0:1776187968.805526:0:10783:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f9a96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+64:2995:x1862467659912576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187968.805546:0:10783:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:236 count 1 00010000:00010000:0.0:1776187968.805565:0:10783:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 3/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.805579:0:10783:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a069a3b7/0x92b1eb87ee41d97c lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18cf expref: 13 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.805586:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.805588:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187968.805590:0:10783:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 4/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.805614:0:10783:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a069a3b7/0x92b1eb87ee41d97c lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18cf expref: 13 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.805628:0:10783:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a069a3b7/0x92b1eb87ee41d97c lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18cf expref: 13 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.805639:0:10783:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007e10840f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10783:1862467659912704:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.805754:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1776187968.805759:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805767:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000aea18492 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.805769:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805777:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805788:0:7120:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ee:0x0].0x0 (0000000086e9bc36) 00010000:00010000:1.0:1776187968.805790:0:7120:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1776187968.805793:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805798:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000aea18492/0x92b1eb87ee43a656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805809:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.805811:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 2/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805817:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000143824d6 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.805819:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 2/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805829:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 3/0,0 mode: PW/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805840:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 1/0,0 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805846:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000143824d6/0x92b1eb87ee43a63a lrc: 0/0,0 mode: --/PW res: [0x11e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805860:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.805862:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.805863:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.805938:0:11829:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d3856f6/0x92b1eb87ee41d73e lrc: 0/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17e1 expref: 13 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.805947:0:11829:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b84092ac pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:11829:1862467659910976:192.168.204.20@tcp:104: 00010000:00010000:1.0:1776187968.805961:0:11829:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805969:0:11829:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805974:0:11829:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805981:0:11829:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.805989:0:11829:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.806001:0:11829:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1776187968.806186:0:11829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000783ba691 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+65:2995:x1862467659910912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 50726us (50775us total) trans 4294968192 rc 0/0 00000100:00100000:1.0:1776187968.806194:0:11829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2892 00010000:00010000:1.0:1776187968.806213:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1776187968.806215:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.806222:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000063e41381 already unused, calling callback (00000000924fc23c) 00010000:00010000:1.0:1776187968.806224:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.806229:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 3/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.806241:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 1/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.806247:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063e41381/0x92b1eb87ee43a5df lrc: 0/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11829 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.806259:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.806260:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187968.806261:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1776187968.806287:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000068f8989e/2, rc 0, transno 893 00000100:00100000:1.0:1776187968.806296:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000068f8989e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659911936:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.806317:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000138d96d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659912640:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1776187968.806345:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1776187968.806367:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000002b2a2aca/2, rc 0, transno 892 00000100:00100000:1.0:1776187968.806371:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b2a2aca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659910656:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1776187968.806381:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000005cd1bbde/2, rc 0, transno 930 00000100:00100000:1.0:1776187968.806386:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005cd1bbde pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659911104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.806403:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659912640 00000100:00100000:1.0:1776187968.806423:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2907 00000100:00100000:1.0:1776187968.806426:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0dce98f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:2993:x1862467659912640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1776187968.806443:0:6326:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:425 count 1 00010000:00010000:1.0:1776187968.806456:0:6326:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 3/0,1 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.806467:0:6326:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc12fcc1/0x92b1eb87ee438604 lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca77d expref: 12 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.806473:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.806475:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1776187968.806476:0:6326:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 4/0,1 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.806496:0:6326:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc12fcc1/0x92b1eb87ee438604 lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca77d expref: 12 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.806504:0:6326:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc12fcc1/0x92b1eb87ee438604 lrc: 4/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca77d expref: 12 pid: 11797 timeout: 545 lvb_type: 0 00000100:00100000:1.0:1776187968.806514:0:6326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004be81521 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6326:1862467659912768:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187968.806812:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187968.807419:0:10783:0:(client.c:2500:ptlrpc_set_wait()) set 00000000f8b224a7 going to sleep for 43 seconds 00000004:00080000:0.0:1776187968.807471:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000007eb3c018/2, rc 0, transno 896 00000100:00100000:0.0:1776187968.807481:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007eb3c018 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659910912:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.807517:0:6329:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064a9183f/0x92b1eb87ee41d887 lrc: 0/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c186d expref: 12 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.807529:0:6329:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd946725 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6329:1862467659912448:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.807543:0:6329:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807550:0:6329:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807555:0:6329:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807562:0:6329:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 3/0,1 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807567:0:6329:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807581:0:6329:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.807772:0:6329:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000183af6c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:2994:x1862467659912256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15992us (17541us total) trans 4294968193 rc 0/0 00000100:00100000:0.0:1776187968.807780:0:6329:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2904 00000004:00080000:0.0:1776187968.807816:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000009ee57b4c/2, rc 0, transno 897 00000100:00100000:0.0:1776187968.807822:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009ee57b4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659912256:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.807834:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.807837:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807844:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.807846:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 2/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807852:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 3/0,0 mode: PW/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807866:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 1/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807871:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a633 lrc: 0/0,0 mode: --/PW res: [0xeb:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807899:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.807900:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.807902:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.807923:0:11794:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f9939dc/0x92b1eb87ee41deae lrc: 0/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1ac7 expref: 15 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:0.0:1776187968.807933:0:11794:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ef5c0c7d pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:11794:1862467659910848:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.807947:0:11794:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807953:0:11794:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807959:0:11794:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807965:0:11794:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 3/0,1 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807971:0:11794:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.807995:0:11794:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.808173:0:11794:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000267f7899 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+65:2995:x1862467659910784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53020us (53077us total) trans 4294968229 rc 0/0 00000100:00100000:0.0:1776187968.808179:0:11794:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2891 00000004:00080000:0.0:1776187968.808204:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000d65b5018/2, rc 0, transno 933 00000100:00100000:0.0:1776187968.808213:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d65b5018 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659910784:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1776187968.808581:0:6326:0:(client.c:2500:ptlrpc_set_wait()) set 00000000688042f6 going to sleep for 6 seconds 00000004:00080000:1.0:1776187968.808613:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000ead899a8/2, rc 0, transno 890 00000100:00100000:1.0:1776187968.808630:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ead899a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659911040:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1776187968.808640:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000095d509fe/2, rc 0, transno 891 00000100:00100000:1.0:1776187968.808643:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095d509fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659910592:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1776187968.808661:0:11825:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.808669:0:11825:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.808676:0:11825:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 3/0,1 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.808682:0:11825:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.808695:0:11825:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1776187968.808754:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1776187968.808758:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.808765:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000e6b57ad6 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.808767:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 2/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.808772:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 3/0,0 mode: PW/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.808786:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 1/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.808791:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6b57ad6/0x92b1eb87ee43a5d8 lrc: 0/0,0 mode: --/PW res: [0xf1:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.808815:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.808817:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.808822:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000cc9474fb already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.808823:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 2/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.808829:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 3/0,0 mode: PW/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.808838:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 1/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.808843:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc9474fb/0x92b1eb87ee43a5ed lrc: 0/0,0 mode: --/PW res: [0x10e:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.808854:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.808855:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.808856:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.808916:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187968.809128:0:11825:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab63205d pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+65:2996:x1862467659911232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 53116us (53162us total) trans 4294968230 rc 0/0 00000100:00100000:1.0:1776187968.809136:0:11825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2894 00000004:00080000:0.0:1776187968.809209:0:2996:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000e88f43fc/2, rc 0, transno 934 00000100:00100000:0.0:1776187968.809218:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e88f43fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659911232:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1776187968.809994:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.810246:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.810358:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430016 00000100:00100000:1.0:1776187968.810405:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15452 00000100:00100000:1.0:1776187968.810411:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098599a18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+34:11414:x1862467653430016:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.810690:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098599a18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+34:11414:x1862467653430016:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 277us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.810699:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15452 00000100:00100000:0.0:1776187968.813819:0:10783:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007e10840f pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10783:1862467659912704:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187968.813826:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:0.0:1776187968.813848:0:10783:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 3/0,1 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.813863:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.813906:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430080 00000100:00100000:0.0:1776187968.813921:0:6326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004be81521 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6326:1862467659912768:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187968.813931:0:6326:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 3/0,1 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.813935:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a069a3b7/0x92b1eb87ee41d97c lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18cf expref: 12 pid: 11825 timeout: 545 lvb_type: 0 00000100:00100000:2.0:1776187968.813974:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430144 00010000:00010000:2.0:1776187968.813985:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc12fcc1/0x92b1eb87ee438604 lrc: 4/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca77d expref: 13 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.813987:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.813996:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.814003:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.814004:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4436 00010000:00010000:3.0:1776187968.814009:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000009d004fc already unused, calling callback (000000004eec1e40) 00000100:00100000:2.0:1776187968.814011:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5641d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+13:2224:x1862467653430080:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187968.814013:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.814019:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814023:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.814027:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a069a3b7/0x92b1eb87ee41d97c lrc: 4/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18cf expref: 13 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.814034:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ed:0x0].0xa375d043 (00000000cfd7bc47) 00010000:00010000:2.0:1776187968.814035:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a069a3b7/0x92b1eb87ee41d97c lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18cf expref: 13 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.814037:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.814041:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.814046:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000009d004fc/0x92b1eb87ee43a648 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ed:0x0].0xa375d043 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814054:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a069a3b7/0x92b1eb87ee41d97c lrc: 0/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c18cf expref: 13 pid: 11825 timeout: 545 lvb_type: 0 00010000:00010000:3.0:1776187968.814067:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814067:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.814069:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187968.814072:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814072:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.814078:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814080:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 4/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.814082:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000006942ede already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.814083:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.814089:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.814095:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ee:0x0].0x0 (0000000086e9bc36) 00010000:00010000:3.0:1776187968.814098:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187968.814100:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.814104:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000006942ede/0x92b1eb87ee43a64f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814112:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1776187968.814148:0:10783:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.814165:0:10783:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.814167:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5641d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+12:2224:x1862467653430080:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 156us (344us total) trans 0 rc 0/0 00010000:00010000:0.0:1776187968.814173:0:10783:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 3/0,1 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.814175:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4436 00010000:00010000:0.0:1776187968.814179:0:10783:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.814197:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4437 00010000:00010000:0.0:1776187968.814198:0:10783:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187968.814201:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007658a4ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+11:2224:x1862467653430144:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1776187968.814214:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187968.814218:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814224:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f73ddd4f already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187968.814227:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 2/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814232:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 3/0,0 mode: PW/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814242:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 1/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814248:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f73ddd4f/0x92b1eb87ee43a65d lrc: 0/0,0 mode: --/PW res: [0xec:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814260:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.814261:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.814262:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.814270:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187968.814273:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc12fcc1/0x92b1eb87ee438604 lrc: 4/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca77d expref: 11 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.814281:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc12fcc1/0x92b1eb87ee438604 lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca77d expref: 11 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.814291:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc12fcc1/0x92b1eb87ee438604 lrc: 0/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca77d expref: 11 pid: 11797 timeout: 545 lvb_type: 0 00010000:00010000:2.0:1776187968.814298:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.814299:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187968.814301:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814307:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 4/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.814321:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187968.814337:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007658a4ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+10:2224:x1862467653430144:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 135us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.814343:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4437 00000100:00100000:0.0:1776187968.814475:0:10783:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f9a96ac pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+66:2995:x1862467659912576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8948us (9008us total) trans 4294968194 rc 0/0 00000100:00100000:0.0:1776187968.814483:0:10783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2906 00010000:00010000:0.0:1776187968.814502:0:6326:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.814509:0:6326:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.814520:0:6326:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 3/0,1 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.814525:0:6326:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.814540:0:6326:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1776187968.814672:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0dce98f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:2993:x1862467659912640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8244us (8327us total) trans 4294968195 rc 0/0 00000100:00100000:0.0:1776187968.814678:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2907 00010000:00010000:0.0:1776187968.814695:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.814698:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.814706:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000474fd8b4 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.814708:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 2/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.814714:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 3/0,0 mode: PW/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.814724:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 1/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.814730:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000474fd8b4/0x92b1eb87ee43a664 lrc: 0/0,0 mode: --/PW res: [0x1a9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1776187968.814731:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000008729ebb9/2, rc 0, transno 898 00000100:00100000:2.0:1776187968.814747:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008729ebb9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659912576:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1776187968.814760:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.814762:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.814763:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1776187968.815431:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000138d96d2/2, rc 0, transno 899 00000100:00100000:0.0:1776187968.815454:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000138d96d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659912640:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1776187968.815725:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.815917:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430272 00000100:00100000:2.0:1776187968.815969:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15453 00000100:00100000:2.0:1776187968.815976:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e10840f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+33:11406:x1862467653430272:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187968.816042:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1776187968.816068:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f978a4bc/0x92b1eb87ee41d31d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ef:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c166e expref: 33 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816103:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000ce2bacf5/0x92b1eb87ee41d00d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ef:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1572 expref: 32 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816116:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000043c35800/0x92b1eb87ee41d332 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ef:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1675 expref: 31 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816128:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000fcedcb9/0x92b1eb87ee41cfff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1ef:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c156b expref: 30 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816137:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ef:0x0].0x0 (000000006bf65e9a) 00010000:00010000:2.0:1776187968.816152:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.816197:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a66b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816216:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a66b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816227:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a66b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816241:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816248:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816253:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816363:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816371:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.816377:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187968.817398:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x3:0x0].433, 64 off35968 00000040:00080000:2.0:1776187968.817422:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4767, 184 off838600 00010000:00010000:2.0:1776187968.817484:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817497:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817506:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817514:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817520:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817526:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817598:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187968.817618:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007e10840f reply state 00000000ff21d48f transno 4294975145 ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817675:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a66b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817682:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a66b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817687:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a66b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817692:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092776876 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.817695:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a66b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817701:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a66b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817712:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ed:0x0].0x0 (00000000434f82b1) 00010000:00010000:2.0:1776187968.817715:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.817719:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a66b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.817724:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a66b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.817728:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000004:00010000:2.0:1776187968.817733:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 000000007e10840f reply state 00000000ff21d48f transno 4294975145 ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.817820:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e10840f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+31:11406:x1862467653430272:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1843us (2096us total) trans 4294975145 rc 0/0 00000100:00100000:2.0:1776187968.817829:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15453 00000100:00100000:2.0:1776187968.817870:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430336 00000100:00100000:2.0:1776187968.817933:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15454 00000100:00100000:2.0:1776187968.817939:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cff3bf8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+31:11414:x1862467653430336:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.818392:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cff3bf8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+31:11414:x1862467653430336:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 452us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.818399:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15454 00010000:00010000:0.0:1776187968.818562:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1776187968.818567:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.818576:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000088423517 already unused, calling callback (00000000924fc23c) 00010000:00010000:0.0:1776187968.818579:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.818586:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.818597:0:5504:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ef:0x0].0x0 (00000000780f5f5c) 00010000:00010000:0.0:1776187968.818599:0:5504:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1776187968.818602:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.818608:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000088423517/0x92b1eb87ee43a680 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187968.818620:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.818621:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187968.818623:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187968.822755:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822778:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822786:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822793:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.822807:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822815:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822833:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ed:0x0].0x820cea43 (0000000079764c80) 00010000:00010000:2.0:1776187968.822838:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.822841:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822847:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a672 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ed:0x0].0x820cea43 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822867:0:2980:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822908:0:2980:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822913:0:2980:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822918:0:2980:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8111509 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.822920:0:2980:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822926:0:2980:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822934:0:2980:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ef:0x0].0x0 (00000000780f5f5c) 00010000:00010000:2.0:1776187968.822936:0:2980:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1776187968.822938:0:2980:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.822943:0:2980:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a679 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1776187968.825446:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.825506:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430400 00000100:00100000:2.0:1776187968.825575:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15455 00000100:00100000:2.0:1776187968.825583:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e380951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:11414:x1862467653430400:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.825920:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e380951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:11414:x1862467653430400:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 337us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.825928:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15455 00000100:00100000:3.0:1776187968.828305:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.828415:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430464 00000100:00100000:2.0:1776187968.828471:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15456 00000100:00100000:2.0:1776187968.828479:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000159566b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:11414:x1862467653430464:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.828748:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000159566b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:11414:x1862467653430464:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 269us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.828756:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15456 00000100:00100000:3.0:1776187968.834846:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.834935:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430528 00000100:00100000:2.0:1776187968.835008:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15457 00000100:00100000:2.0:1776187968.835015:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c63d6d4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:11414:x1862467653430528:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.835479:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c63d6d4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:11414:x1862467653430528:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 462us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.835487:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15457 00000100:00100000:3.0:1776187968.837084:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.837238:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430656 00000100:00100000:2.0:1776187968.837298:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4522 00000100:00100000:2.0:1776187968.837305:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a166849e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+30:11406:x1862467653430656:12345-192.168.204.20@tcp:35:rm.0 00000100:00100000:2.0:1776187968.837570:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a166849e pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+31:11406:x1862467653430656:12345-192.168.204.20@tcp:35:rm.0 Request processed in 264us (492us total) trans 4294975146 rc 0/0 00000100:00100000:2.0:1776187968.837582:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4522 00000100:00100000:0.0:1776187968.840064:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.840257:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430720 00000100:00100000:2.0:1776187968.840315:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15458 00000100:00100000:2.0:1776187968.840322:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007868c699 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+31:11414:x1862467653430720:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.840554:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007868c699 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+31:11414:x1862467653430720:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 231us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.840562:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15458 00000100:00100000:3.0:1776187968.841962:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.842017:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430848 00000100:00100000:2.0:1776187968.842071:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15459 00000100:00100000:2.0:1776187968.842078:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eef192f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+31:11406:x1862467653430848:12345-192.168.204.20@tcp:36:rm.0 00010000:00010000:2.0:1776187968.842310:0:6573:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1776187968.842338:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000025591595/0x92b1eb87ee420ff4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f0:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2e3f expref: 31 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842361:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000019c0f4c/0x92b1eb87ee41d13a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f0:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c15d4 expref: 30 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842374:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009a77b121/0x92b1eb87ee41d068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1f0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c158e expref: 29 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842383:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009fedd1e8/0x92b1eb87ee420f76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2e15 expref: 28 pid: 5515 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842394:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000003987b887/0x92b1eb87ee41d05a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1f0:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1587 expref: 27 pid: 5517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842407:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f0:0x0].0x0 (0000000047bfcbe2) 00010000:00010000:2.0:1776187968.842416:0:6573:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1776187968.842447:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a687 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842461:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a687 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842471:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a687 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842484:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842490:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842496:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842591:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842599:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.842606:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1776187968.843434:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0x6:0x0].432, 64 off35904 00000040:00080000:2.0:1776187968.843456:0:6573:0:(llog_osd.c:738:llog_osd_write_rec()) added record [0x1:0xa:0x0].4768, 192 off838792 00010000:00010000:2.0:1776187968.843519:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843531:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843538:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843545:0:6573:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843551:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843556:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843583:0:6573:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00010000:2.0:1776187968.843602:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000eef192f3 reply state 0000000001953ad9 transno 4294975147 ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843658:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a687 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843666:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a687 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843677:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a687 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843682:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8111509 already unused, calling callback (000000004eec1e40) 00010000:00010000:2.0:1776187968.843686:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a687 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843693:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a687 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843705:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ed:0x0].0x0 (00000000434f82b1) 00010000:00010000:2.0:1776187968.843707:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1776187968.843711:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a687 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187968.843717:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000f8111509/0x92b1eb87ee43a687 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1ed:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1776187968.843727:0:6573:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request 00000000eef192f3 reply state 0000000001953ad9 transno 4294975147 ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187968.843830:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eef192f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11406:x1862467653430848:12345-192.168.204.20@tcp:36:rm.0 Request processed in 1750us (1873us total) trans 4294975147 rc 0/0 00000100:00100000:2.0:1776187968.843839:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15459 00010000:00010000:3.0:1776187968.845960:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187968.845969:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.845983:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b6daaca9 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187968.845986:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.845994:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.846011:0:5503:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f0:0x0].0x0 (0000000079764c80) 00010000:00010000:3.0:1776187968.846014:0:5503:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1776187968.846017:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.846022:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000b6daaca9/0x92b1eb87ee43a69c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 18446634309361107392 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.846036:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.846037:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187968.846038:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187968.846487:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.846579:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430912 00000100:00100000:1.0:1776187968.846735:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15460 00000100:00100000:1.0:1776187968.846742:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006a3043d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653430912:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.847215:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a3043d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653430912:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 472us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.847226:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15460 00010000:00010000:3.0:1776187968.851924:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.851947:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.851953:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.851960:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002e544251 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.851964:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.851972:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187968.851979:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:3.0:1776187968.851990:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ed:0x0].0x6fca4125 (00000000780f5f5c) 00010000:00010000:3.0:1776187968.851993:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1776187968.851997:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.852003:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002e544251/0x92b1eb87ee43a68e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1ed:0x0].0x6fca4125 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.852021:0:2979:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.852027:0:2979:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.852032:0:2979:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.852036:0:2979:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000092776876 already unused, calling callback (000000004eec1e40) 00010000:00010000:3.0:1776187968.852037:0:2979:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.852042:0:2979:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.852049:0:2979:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1f0:0x0].0x0 (0000000079764c80) 00010000:00010000:3.0:1776187968.852051:0:2979:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1776187968.852052:0:2979:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187968.852056:0:2979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 0000000092776876/0x92b1eb87ee43a695 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1776187968.852216:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653430976 00000100:00100000:1.0:1776187968.852264:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15461 00000100:00100000:1.0:1776187968.852271:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b5b3a1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+27:11277:x1862467653430976:12345-192.168.204.20@tcp:101:bash.0 00010000:00010000:1.0:1776187968.852294:0:6573:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1776187968.852312:0:6573:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a6a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac38 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.852374:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43a6aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.852388:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43a6aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.852398:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43a6aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.852412:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a6b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.852418:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.852424:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.852777:0:6573:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a6b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.852786:0:6573:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.852794:0:6573:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1776187968.852841:0:6573:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1ea:0x0]: returning size 11776 00000004:00200000:1.0:1776187968.852845:0:6573:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1776187968.852866:0:6573:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a6b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853059:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43a6aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853066:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43a6aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853072:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43a6aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853077:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d9325880 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.853080:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43a6aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853085:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43a6aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853196:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (000000000eb42cef) 00010000:00010000:1.0:1776187968.853198:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187968.853202:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43a6aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853208:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000d9325880/0x92b1eb87ee43a6aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853221:0:6573:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a6b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853226:0:6573:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a6b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853231:0:6573:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853236:0:6573:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000002adbeaf3 already unused, calling callback (000000004eec1e40) 00010000:00010000:1.0:1776187968.853238:0:6573:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a6b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853243:0:6573:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a6b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853249:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa5c7b510 (00000000a45e680a) 00010000:00010000:1.0:1776187968.853252:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1776187968.853253:0:6573:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a6b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853258:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000002adbeaf3/0x92b1eb87ee43a6b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa5c7b510 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853291:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000000ea47fb5/0x92b1eb87ee43a6a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac38 expref: 29 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853303:0:6573:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000002e3273a0/0x92b1eb87ee43a6b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ea:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac38 expref: 28 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1776187968.853309:0:6573:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ea:0x0].0x0 (0000000077c38ae7) 00010000:00010000:1.0:1776187968.853310:0:6573:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1776187968.853312:0:6573:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002e3273a0, rc 0) 00000100:00100000:1.0:1776187968.853437:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b5b3a1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11277:x1862467653430976:12345-192.168.204.20@tcp:101:bash.0 Request processed in 1165us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.853445:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15461 00000100:00100000:0.0:1776187968.854990:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.855397:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431040 00000100:00100000:3.0:1776187968.855461:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15462 00000100:00100000:3.0:1776187968.855467:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007baa2a36 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431040:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187968.855829:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007baa2a36 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431040:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 360us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.855838:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15462 00000100:00100000:2.0:1776187968.860978:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.861110:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431104 00000100:00100000:3.0:1776187968.861177:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15463 00000100:00100000:3.0:1776187968.861183:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008256682a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431104:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187968.861421:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008256682a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431104:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 237us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.861429:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15463 00000100:00100000:0.0:1776187968.863575:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.863824:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431168 00000100:00100000:1.0:1776187968.864020:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15464 00000100:00100000:1.0:1776187968.864029:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098b0ffb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431168:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187968.864291:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098b0ffb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431168:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 262us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.864301:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15464 00000100:00100000:1.0:1776187968.869066:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.869216:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431232 00000100:00100000:3.0:1776187968.869274:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15465 00000100:00100000:3.0:1776187968.869280:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b0b6bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431232:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187968.869527:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b0b6bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431232:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 245us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187968.869537:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15465 00000100:00100000:2.0:1776187968.872913:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.872996:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431296 00000100:00100000:1.0:1776187968.873059:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15466 00000100:00100000:1.0:1776187968.873065:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000092e338f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431296:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187968.873465:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000092e338f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431296:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 397us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.873476:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15466 00000100:00100000:0.0:1776187968.877537:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.877815:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431360 00000100:00100000:3.0:1776187968.877871:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15467 00000100:00100000:3.0:1776187968.877908:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f9e39f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431360:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.878780:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f9e39f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431360:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 868us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.878793:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15467 00000100:00100000:1.0:1776187968.881491:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.881590:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431424 00000100:00100000:2.0:1776187968.881715:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15468 00000100:00100000:2.0:1776187968.881722:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073816638 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431424:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.881970:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073816638 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431424:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 247us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.881980:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15468 00000100:00100000:3.0:1776187968.886715:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.886782:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431488 00000100:00100000:2.0:1776187968.886844:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15469 00000100:00100000:2.0:1776187968.886851:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c143a717 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431488:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.887568:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c143a717 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431488:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 713us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.887578:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15469 00000100:00100000:1.0:1776187968.891301:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.891679:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431552 00000100:00100000:2.0:1776187968.891741:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15470 00000100:00100000:2.0:1776187968.891748:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000058b4d758 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431552:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.892255:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000058b4d758 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431552:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 505us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.892265:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15470 00000100:00100000:1.0:1776187968.894314:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.894588:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431616 00000100:00100000:2.0:1776187968.894646:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15471 00000100:00100000:2.0:1776187968.894652:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000493cfb9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431616:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187968.894926:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000493cfb9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431616:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 272us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.894935:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15471 00000100:00100000:3.0:1776187968.898250:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.898454:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.899231:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431744 00000100:00100000:0.0:1776187968.899231:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431680 00000100:00100000:2.0:1776187968.899287:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15472 00000100:00100000:0.0:1776187968.899321:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15473 00000100:00100000:0.0:1776187968.899326:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009356d08a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:11411:x1862467653431680:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187968.899358:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x37d:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1776187968.899426:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007df4caca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:11414:x1862467653431744:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000004:00000080:0.0:1776187968.899445:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x37d:0x0]: rc = -2 00000100:00100000:0.0:1776187968.899502:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009356d08a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:11411:x1862467653431680:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 175us (1261us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187968.899509:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15473 00000100:00100000:2.0:1776187968.899561:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007df4caca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431744:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 268us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187968.899569:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15472 00000100:00100000:1.0:1776187968.903586:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.903731:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431808 00000100:00100000:0.0:1776187968.903799:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15474 00000100:00100000:0.0:1776187968.903806:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b876fd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653431808:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187968.903839:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187968.904025:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:0.0:1776187968.904284:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b876fd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653431808:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 477us (704us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187968.904293:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15474 00000100:00100000:1.0:1776187968.905777:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.906067:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431872 00000100:00100000:0.0:1776187968.906132:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15475 00000100:00100000:0.0:1776187968.906139:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002381005a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431872:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187968.906595:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002381005a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653431872:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 454us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.906604:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15475 00000100:00100000:1.0:1776187968.909788:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.909975:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653431936 00000100:00100000:0.0:1776187968.910143:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15476 00000100:00100000:0.0:1776187968.910151:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000545884de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653431936:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187968.910196:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187968.910306:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:0.0:1776187968.910359:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000545884de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653431936:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 208us (581us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187968.910366:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15476 00000100:00100000:1.0:1776187968.914221:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.914390:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432000 00000100:00100000:0.0:1776187968.914458:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15477 00000100:00100000:0.0:1776187968.914465:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f692565e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653432000:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187968.914722:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f692565e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653432000:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 256us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.914731:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15477 00000100:00100000:2.0:1776187968.916459:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.916553:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432064 00000100:00100000:1.0:1776187968.916612:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15478 00000100:00100000:1.0:1776187968.916618:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098599a18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432064:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187968.916659:0:5515:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x37e:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187968.916742:0:5515:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x37e:0x0]: rc = -2 00000100:00100000:1.0:1776187968.916798:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098599a18 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432064:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 179us (345us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187968.916806:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15478 00000100:00100000:2.0:1776187968.925054:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187968.925145:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.925234:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432128 00000100:00100000:1.0:1776187968.925298:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432192 00000100:00100000:1.0:1776187968.925327:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15479 00000100:00100000:1.0:1776187968.925335:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000048466f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:11414:x1862467653432128:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187968.925447:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15480 00000100:00100000:3.0:1776187968.925453:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000303dd311 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:11411:x1862467653432192:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187968.925476:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1776187968.925553:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000048466f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:11414:x1862467653432128:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 218us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.925561:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15479 00000004:00000080:3.0:1776187968.925562:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:3.0:1776187968.925583:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000303dd311 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432192:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 130us (440us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187968.925589:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15480 00000100:00100000:2.0:1776187968.930061:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.930286:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432256 00000100:00100000:0.0:1776187968.930353:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15481 00000100:00100000:0.0:1776187968.930360:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000013546a3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653432256:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187968.930569:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000013546a3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653432256:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 208us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187968.930582:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15481 00000100:00100000:1.0:1776187968.935788:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.935843:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432320 00000100:00100000:3.0:1776187968.935912:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15482 00000100:00100000:3.0:1776187968.935919:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5b78340 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432320:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187968.935953:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1776187968.936023:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.936057:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432384 00000004:00000080:3.0:1776187968.936058:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187968.936085:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15483 00000100:00100000:1.0:1776187968.936089:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016e0d7aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:11414:x1862467653432384:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187968.936112:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5b78340 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:11411:x1862467653432320:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 193us (330us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187968.936119:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15482 00000100:00100000:1.0:1776187968.936246:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016e0d7aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11414:x1862467653432384:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 155us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187968.936253:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15483 00000100:00100000:3.0:1776187968.940213:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.941522:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432448 00000100:00100000:1.0:1776187968.941630:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15484 00000100:00100000:1.0:1776187968.941646:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e54ebaad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432448:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187968.941686:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x37f:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187968.941782:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x37f:0x0]: rc = -2 00000100:00100000:1.0:1776187968.941852:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e54ebaad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432448:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 207us (1647us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187968.941860:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15484 00000100:00100000:2.0:1776187968.950783:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187968.951333:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432512 00000100:00100000:2.0:1776187968.953356:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15485 00000100:00100000:2.0:1776187968.953368:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b9316eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432512:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187968.953408:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187968.953513:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:2.0:1776187968.956579:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b9316eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432512:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 3194us (5791us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187968.956597:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15485 00000100:00100000:2.0:1776187968.965362:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.965495:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432576 00000100:00100000:0.0:1776187968.965555:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15486 00000100:00100000:0.0:1776187968.965562:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6f393cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432576:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187968.965602:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187968.965701:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:0.0:1776187968.965759:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6f393cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432576:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 196us (406us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187968.965767:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15486 00000100:00100000:0.0:1776187968.973492:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.973707:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432640 00000100:00100000:3.0:1776187968.973771:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15487 00000100:00100000:3.0:1776187968.973778:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8967a46 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432640:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187968.973816:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x380:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187968.973970:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x380:0x0]: rc = -2 00000100:00100000:3.0:1776187968.974041:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8967a46 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432640:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 261us (559us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187968.974050:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15487 00000100:00100000:2.0:1776187968.980592:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.980802:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432704 00000100:00100000:0.0:1776187968.980866:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15488 00000100:00100000:0.0:1776187968.980911:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085fc26ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432704:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187968.980949:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x381:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187968.981047:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x381:0x0]: rc = -2 00000100:00100000:0.0:1776187968.981104:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085fc26ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432704:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 230us (526us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187968.981112:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15488 00000100:00100000:2.0:1776187968.991781:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187968.992108:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432768 00000100:00100000:3.0:1776187968.992173:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15489 00000100:00100000:3.0:1776187968.992179:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7a98837 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432768:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187968.992212:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187968.992301:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:3.0:1776187968.992358:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7a98837 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432768:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 178us (586us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187968.992366:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15489 00000100:00100000:1.0:1776187968.997847:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187968.997990:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432832 00000100:00100000:0.0:1776187968.998042:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15490 00000100:00100000:0.0:1776187968.998048:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a01f2b9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432832:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187968.998084:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187968.998205:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:0.0:1776187968.998263:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a01f2b9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432832:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 214us (426us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187968.998272:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15490 00000100:00100000:2.0:1776187969.005003:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.005144:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432896 00000100:00100000:3.0:1776187969.005248:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15491 00000100:00100000:3.0:1776187969.005255:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db84b536 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432896:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.005305:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.005422:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:3.0:1776187969.005495:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db84b536 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432896:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 239us (499us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.005504:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15491 00000100:00100000:2.0:1776187969.009690:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.009985:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653432960 00000100:00100000:0.0:1776187969.010089:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15492 00000100:00100000:0.0:1776187969.010096:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000946cec49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432960:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.010133:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.010248:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:0.0:1776187969.010318:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000946cec49 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653432960:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 221us (638us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.010326:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15492 00000100:00100000:1.0:1776187969.019105:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.020848:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433024 00000100:00100000:2.0:1776187969.023016:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15493 00000100:00100000:2.0:1776187969.023028:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ff1b27a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433024:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.023064:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x382:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.023171:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x382:0x0]: rc = -2 00000100:00100000:2.0:1776187969.023250:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ff1b27a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433024:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 222us (4152us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.023259:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15493 00000100:00100000:2.0:1776187969.031491:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.031985:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433088 00000100:00100000:3.0:1776187969.032053:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15494 00000100:00100000:3.0:1776187969.032061:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009351f964 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433088:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.032102:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x383:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.032209:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x383:0x0]: rc = -2 00000100:00100000:3.0:1776187969.032277:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009351f964 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433088:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 216us (794us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.032285:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15494 00000100:00100000:1.0:1776187969.043893:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.043951:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433152 00000100:00100000:3.0:1776187969.044176:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15495 00000100:00100000:3.0:1776187969.044183:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e3696e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433152:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.044221:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.044484:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:3.0:1776187969.044548:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e3696e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433152:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 364us (680us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.044556:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15495 00000100:00100000:0.0:1776187969.056038:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.056260:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433216 00000100:00100000:1.0:1776187969.056325:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15496 00000100:00100000:1.0:1776187969.056331:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5ef1e90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433216:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.056361:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.056446:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187969.056507:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5ef1e90 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433216:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 176us (477us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.056515:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15496 00000100:00100000:2.0:1776187969.062137:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.062255:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433280 00000100:00100000:3.0:1776187969.062310:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15497 00000100:00100000:3.0:1776187969.062317:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3c6c764 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433280:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.062364:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.062468:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:3.0:1776187969.062528:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3c6c764 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433280:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 210us (399us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.062536:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15497 00000100:00100000:2.0:1776187969.075812:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.076146:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433344 00000100:00100000:1.0:1776187969.076216:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15498 00000100:00100000:1.0:1776187969.076222:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b40c6e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433344:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.076265:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.076374:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187969.076434:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b40c6e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433344:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 211us (630us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.076441:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15498 00000100:00100000:0.0:1776187969.084182:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.084354:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433408 00000100:00100000:1.0:1776187969.084421:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15499 00000100:00100000:1.0:1776187969.084428:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082814a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433408:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.084464:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x384:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.084570:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x384:0x0]: rc = -2 00000100:00100000:1.0:1776187969.084640:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082814a1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433408:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 212us (468us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.084647:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15499 00000100:00100000:2.0:1776187969.093478:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.093567:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433472 00000100:00100000:3.0:1776187969.093622:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15500 00000100:00100000:3.0:1776187969.093628:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000098b87e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433472:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.093662:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.093751:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:3.0:1776187969.093814:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000098b87e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433472:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 185us (345us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.093822:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15500 00000100:00100000:2.0:1776187969.098386:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.098470:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433536 00000100:00100000:1.0:1776187969.098523:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15501 00000100:00100000:1.0:1776187969.098529:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b53874c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433536:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.098560:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.098643:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:1.0:1776187969.098697:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b53874c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433536:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 168us (319us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.098705:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15501 00000100:00100000:3.0:1776187969.101806:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.103521:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433600 00000100:00100000:2.0:1776187969.103588:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15502 00000100:00100000:2.0:1776187969.103595:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009df99463 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433600:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.103630:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x385:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.103720:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x385:0x0]: rc = -2 00000100:00100000:2.0:1776187969.103794:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009df99463 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433600:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 198us (1995us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.103801:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15502 00000100:00100000:2.0:1776187969.108854:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.108993:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433664 00000100:00100000:2.0:1776187969.109134:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15503 00000100:00100000:2.0:1776187969.109143:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd00cbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433664:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.109197:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.109297:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:2.0:1776187969.109372:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd00cbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433664:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 229us (525us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.109380:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15503 00000100:00100000:3.0:1776187969.112282:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.114604:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433728 00000100:00100000:0.0:1776187969.114675:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15504 00000100:00100000:0.0:1776187969.114681:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066aec016 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433728:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.114718:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.114809:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:0.0:1776187969.114922:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066aec016 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433728:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 241us (2648us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.114930:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15504 00000100:00100000:0.0:1776187969.123388:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.123528:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433792 00000100:00100000:2.0:1776187969.123596:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15505 00000100:00100000:2.0:1776187969.123604:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b8d2943 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433792:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.123639:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.123739:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:2.0:1776187969.123809:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b8d2943 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433792:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 205us (431us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.123817:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15505 00000100:00100000:3.0:1776187969.128082:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.128213:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433856 00000100:00100000:0.0:1776187969.128313:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15506 00000100:00100000:0.0:1776187969.128321:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081464c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433856:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.128373:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.128476:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:0.0:1776187969.128547:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081464c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433856:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 226us (472us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.128555:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15506 00000100:00100000:3.0:1776187969.131913:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.141422:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433920 00000100:00100000:2.0:1776187969.141510:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15507 00000100:00100000:2.0:1776187969.141516:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000942efc84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433920:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.141557:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.141660:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:2.0:1776187969.141726:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000942efc84 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433920:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 208us (9859us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.141734:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15507 00000100:00100000:3.0:1776187969.146021:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.146070:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653433984 00000100:00100000:3.0:1776187969.146128:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15508 00000100:00100000:3.0:1776187969.146136:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a4a24cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433984:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.146183:0:5515:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.146286:0:5515:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:3.0:1776187969.146340:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a4a24cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653433984:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 203us (329us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.146349:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15508 00000100:00100000:3.0:1776187969.151300:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.152058:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434048 00000100:00100000:2.0:1776187969.152120:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15509 00000100:00100000:2.0:1776187969.152127:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000668f2aeb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434048:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.152174:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x386:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.152266:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x386:0x0]: rc = -2 00000100:00100000:2.0:1776187969.152321:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000668f2aeb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434048:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 194us (1030us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.152749:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15509 00000100:00100000:3.0:1776187969.154766:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.154842:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434112 00000100:00100000:2.0:1776187969.154998:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15510 00000100:00100000:2.0:1776187969.155008:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cff3bf8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434112:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.155050:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x387:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.155140:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x387:0x0]: rc = -2 00000100:00100000:2.0:1776187969.155241:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cff3bf8c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434112:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 233us (483us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.155249:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15510 00000100:00100000:3.0:1776187969.166801:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.166926:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434176 00000100:00100000:2.0:1776187969.166993:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15511 00000100:00100000:2.0:1776187969.167000:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e380951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434176:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.167039:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.167164:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:2.0:1776187969.167230:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e380951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434176:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 229us (436us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.167238:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15511 00000100:00100000:3.0:1776187969.178820:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.178979:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434240 00000100:00100000:2.0:1776187969.179042:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15512 00000100:00100000:2.0:1776187969.179049:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000159566b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434240:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.179083:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.179184:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:2.0:1776187969.179261:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000159566b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434240:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 211us (449us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.179269:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15512 00000100:00100000:3.0:1776187969.183756:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.183922:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434304 00000100:00100000:1.0:1776187969.183985:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15513 00000100:00100000:1.0:1776187969.183994:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c63d6d4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434304:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.184034:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.184143:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187969.184216:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c63d6d4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434304:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 223us (468us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.184224:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15513 00000100:00100000:3.0:1776187969.189654:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.189991:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434368 00000100:00100000:2.0:1776187969.190052:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15514 00000100:00100000:2.0:1776187969.190059:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ba94a74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434368:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.190095:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.190220:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:2.0:1776187969.190295:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ba94a74 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434368:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 235us (650us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.190303:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15514 00000100:00100000:3.0:1776187969.193793:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.193979:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434432 00000100:00100000:1.0:1776187969.194038:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15515 00000100:00100000:1.0:1776187969.194044:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007485566e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434432:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.194077:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x388:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.194194:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x388:0x0]: rc = -2 00000100:00100000:1.0:1776187969.194272:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007485566e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434432:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 227us (486us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.194281:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15515 00000100:00100000:3.0:1776187969.202345:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.202584:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434496 00000100:00100000:2.0:1776187969.202638:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15516 00000100:00100000:2.0:1776187969.202644:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4fe90f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434496:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.202685:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.202776:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:2.0:1776187969.202849:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4fe90f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434496:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 204us (511us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.202857:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15516 00000100:00100000:3.0:1776187969.209097:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.210474:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434560 00000100:00100000:1.0:1776187969.210553:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15517 00000100:00100000:1.0:1776187969.210562:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d93a4cc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434560:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.210602:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.210691:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:1.0:1776187969.210761:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d93a4cc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434560:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 198us (1671us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.210769:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15517 00000100:00100000:3.0:1776187969.213835:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.214075:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434624 00000100:00100000:2.0:1776187969.214145:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15518 00000100:00100000:2.0:1776187969.214161:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5133036 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434624:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.214200:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x389:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.214320:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x389:0x0]: rc = -2 00000100:00100000:2.0:1776187969.214397:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5133036 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434624:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 235us (574us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.214405:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15518 00000100:00100000:3.0:1776187969.219486:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.219563:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434688 00000100:00100000:1.0:1776187969.219627:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15519 00000100:00100000:1.0:1776187969.219634:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041ae9e4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434688:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.219673:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x38a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.219775:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x38a:0x0]: rc = -2 00000100:00100000:1.0:1776187969.219840:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041ae9e4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434688:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 206us (363us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.219849:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15519 00000100:00100000:3.0:1776187969.224010:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.224120:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434752 00000100:00100000:2.0:1776187969.224191:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15520 00000100:00100000:2.0:1776187969.224198:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e92b74b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434752:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.224231:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.224337:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:2.0:1776187969.224399:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e92b74b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434752:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 201us (397us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.224407:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15520 00000100:00100000:3.0:1776187969.228347:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.229222:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434816 00000100:00100000:1.0:1776187969.229287:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15521 00000100:00100000:1.0:1776187969.229294:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000280743fd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434816:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.229330:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.229420:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:1.0:1776187969.229485:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000280743fd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434816:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 190us (1145us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.229493:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15521 00000100:00100000:3.0:1776187969.239753:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.241520:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434880 00000100:00100000:1.0:1776187969.241598:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15522 00000100:00100000:1.0:1776187969.241605:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f17c2333 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434880:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.241652:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.241771:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187969.241856:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f17c2333 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434880:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 250us (2113us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.241865:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15522 00000100:00100000:3.0:1776187969.247674:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.248471:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653434944 00000100:00100000:2.0:1776187969.248585:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15523 00000100:00100000:2.0:1776187969.248593:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005a275ea2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434944:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.248647:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.248747:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:2.0:1776187969.248816:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005a275ea2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653434944:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 223us (1150us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.248825:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15523 00000100:00100000:3.0:1776187969.251772:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.251868:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435008 00000100:00100000:2.0:1776187969.251956:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15524 00000100:00100000:2.0:1776187969.251963:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000007aa6988 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435008:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.252006:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x38b:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.252095:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x38b:0x0]: rc = -2 00000100:00100000:2.0:1776187969.252162:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000007aa6988 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435008:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 198us (398us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.252170:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15524 00000100:00100000:3.0:1776187969.257450:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.257583:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435072 00000100:00100000:1.0:1776187969.257653:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15525 00000100:00100000:1.0:1776187969.257660:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e6dfd99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435072:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.257698:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x38c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.257796:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x38c:0x0]: rc = -2 00000100:00100000:1.0:1776187969.257857:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e6dfd99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435072:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 197us (417us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.257865:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15525 00000100:00100000:3.0:1776187969.262202:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.262335:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435136 00000100:00100000:2.0:1776187969.262396:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15526 00000100:00100000:2.0:1776187969.262402:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000745b1f8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435136:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.262438:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.262529:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:2.0:1776187969.262593:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000745b1f8b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435136:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 189us (400us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.262601:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15526 00000100:00100000:3.0:1776187969.267710:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.269650:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435200 00000100:00100000:1.0:1776187969.269730:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15527 00000100:00100000:1.0:1776187969.269736:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000821c619e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435200:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.269776:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.269894:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:1.0:1776187969.270068:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000821c619e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435200:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 330us (2366us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.270077:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15527 00000100:00100000:3.0:1776187969.274277:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.274494:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435264 00000100:00100000:2.0:1776187969.274582:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15528 00000100:00100000:2.0:1776187969.274589:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aeb0ddc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435264:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.274626:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.274725:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:2.0:1776187969.274793:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aeb0ddc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435264:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 203us (525us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.274801:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15528 00000100:00100000:3.0:1776187969.279433:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.281195:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435328 00000100:00100000:1.0:1776187969.281302:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15529 00000100:00100000:1.0:1776187969.281319:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9a8472 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435328:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.281356:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.281455:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:1.0:1776187969.281520:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9a8472 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435328:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 201us (2097us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.281529:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15529 00000100:00100000:3.0:1776187969.284823:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.285825:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435392 00000100:00100000:1.0:1776187969.285910:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15530 00000100:00100000:1.0:1776187969.285918:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082dfa6ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435392:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.285957:0:5515:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x38d:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.286065:0:5515:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x38d:0x0]: rc = -2 00000100:00100000:1.0:1776187969.286137:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082dfa6ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435392:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 218us (1323us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.286155:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15530 00000100:00100000:3.0:1776187969.293233:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.293343:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435456 00000100:00100000:0.0:1776187969.293433:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15531 00000100:00100000:0.0:1776187969.293440:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071c80bbe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435456:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.293476:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.293573:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:0.0:1776187969.293643:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071c80bbe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435456:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 202us (418us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.293651:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15531 00000100:00100000:1.0:1776187969.297138:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.299220:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435520 00000100:00100000:3.0:1776187969.299592:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15532 00000100:00100000:3.0:1776187969.299601:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba1d3e5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435520:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.299738:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.299835:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:3.0:1776187969.300123:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba1d3e5b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435520:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 520us (2994us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.300132:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15532 00000100:00100000:0.0:1776187969.308997:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.309271:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435584 00000100:00100000:3.0:1776187969.309453:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15533 00000100:00100000:3.0:1776187969.309462:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7220d98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435584:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.309498:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x38e:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.309598:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x38e:0x0]: rc = -2 00000100:00100000:3.0:1776187969.309679:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7220d98 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435584:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 217us (690us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.309688:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15533 00000100:00100000:0.0:1776187969.313718:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.313906:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435648 00000100:00100000:3.0:1776187969.313978:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15534 00000100:00100000:3.0:1776187969.313985:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d19b542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435648:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.314027:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x38f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.314128:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x38f:0x0]: rc = -2 00000100:00100000:3.0:1776187969.314189:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d19b542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435648:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 204us (478us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.314197:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15534 00000100:00100000:2.0:1776187969.319422:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.319822:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435712 00000100:00100000:1.0:1776187969.319917:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15535 00000100:00100000:1.0:1776187969.319925:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000207f3cc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435712:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.319962:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.320339:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:1.0:1776187969.320412:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000207f3cc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435712:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 487us (1000us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.320421:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15535 00000100:00100000:0.0:1776187969.325165:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.325285:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435776 00000100:00100000:3.0:1776187969.325355:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15536 00000100:00100000:3.0:1776187969.325363:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037c823f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435776:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.325402:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.325514:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:3.0:1776187969.325579:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037c823f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435776:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 215us (430us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.325586:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15536 00000100:00100000:0.0:1776187969.330929:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.331496:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435840 00000100:00100000:3.0:1776187969.331562:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15537 00000100:00100000:3.0:1776187969.331569:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000643fa20e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435840:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.331603:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.331711:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:3.0:1776187969.331786:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000643fa20e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435840:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 216us (864us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.331799:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15537 00000100:00100000:2.0:1776187969.335568:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.335740:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435904 00000100:00100000:0.0:1776187969.336584:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15538 00000100:00100000:0.0:1776187969.336595:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041aa866a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435904:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.336643:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.336754:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:0.0:1776187969.336836:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041aa866a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435904:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 243us (1279us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.336844:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15538 00000100:00100000:1.0:1776187969.341011:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.341449:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653435968 00000100:00100000:0.0:1776187969.341517:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15539 00000100:00100000:0.0:1776187969.341525:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc603d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435968:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.341562:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.341671:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:0.0:1776187969.341747:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc603d25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653435968:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 222us (744us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.341755:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15539 00000100:00100000:1.0:1776187969.345250:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.345440:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436032 00000100:00100000:3.0:1776187969.345538:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15540 00000100:00100000:3.0:1776187969.345545:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004be81521 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436032:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.345580:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.345684:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:3.0:1776187969.345784:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004be81521 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436032:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 239us (542us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.345792:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15540 00000100:00100000:2.0:1776187969.349958:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.351007:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436096 00000100:00100000:3.0:1776187969.351069:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15541 00000100:00100000:3.0:1776187969.351075:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9511a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436096:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.351110:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.351217:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:3.0:1776187969.351398:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9511a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436096:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 322us (1451us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.351406:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15541 00000100:00100000:2.0:1776187969.354685:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.355066:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436160 00000100:00100000:0.0:1776187969.355163:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15542 00000100:00100000:0.0:1776187969.355171:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006249c4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436160:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.355211:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.355342:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:0.0:1776187969.355408:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006249c4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436160:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 237us (732us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.355415:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15542 00000100:00100000:2.0:1776187969.358919:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.359546:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436224 00000100:00100000:3.0:1776187969.359607:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15543 00000100:00100000:3.0:1776187969.359625:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000917ac354 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436224:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.359664:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f4:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.359772:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f4:0x0]: rc = -2 00000100:00100000:3.0:1776187969.360046:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000917ac354 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436224:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 431us (1133us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.360059:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15543 00000100:00100000:2.0:1776187969.364268:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.364448:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436288 00000100:00100000:0.0:1776187969.364540:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15544 00000100:00100000:0.0:1776187969.364548:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f4e8b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436288:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.364590:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.364800:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f4:0x0]: rc = -2 00000100:00100000:0.0:1776187969.364942:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f4e8b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436288:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 394us (683us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.364951:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15544 00000100:00100000:2.0:1776187969.377069:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.378637:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436352 00000100:00100000:0.0:1776187969.378757:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15545 00000100:00100000:0.0:1776187969.378765:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006538300c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436352:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.378808:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.378952:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:0.0:1776187969.379019:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006538300c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436352:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 254us (1957us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.379027:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15545 00010000:00010000:0.0:1776187969.385340:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187969.386667:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.386763:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436416 00000100:00100000:0.0:1776187969.386825:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15546 00000100:00100000:0.0:1776187969.386832:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d058849 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436416:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.386865:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.387004:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:0.0:1776187969.387069:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d058849 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436416:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 236us (411us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.387078:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15546 00000100:00100000:2.0:1776187969.390679:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.391266:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436480 00000100:00100000:3.0:1776187969.391329:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15547 00000100:00100000:3.0:1776187969.391335:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a3f804d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436480:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.391369:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.391467:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:3.0:1776187969.391534:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a3f804d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436480:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 197us (863us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.391542:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15547 00000100:00100000:2.0:1776187969.399159:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.399280:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436544 00000100:00100000:0.0:1776187969.399354:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15548 00000100:00100000:0.0:1776187969.399361:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044f45045 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436544:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.399397:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.399493:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:0.0:1776187969.399553:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044f45045 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436544:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 192us (418us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.399561:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15548 00000100:00100000:2.0:1776187969.402537:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.402916:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436608 00000100:00100000:3.0:1776187969.402978:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15549 00000100:00100000:3.0:1776187969.402986:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035ef4933 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436608:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.403020:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.403112:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:3.0:1776187969.403233:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035ef4933 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436608:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 247us (702us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.403241:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15549 00000100:00100000:2.0:1776187969.408493:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.408604:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436672 00000100:00100000:0.0:1776187969.408675:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15550 00000100:00100000:0.0:1776187969.408682:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006144809d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436672:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.408734:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.408842:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:0.0:1776187969.409296:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006144809d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436672:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 611us (809us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.409305:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15550 00000100:00100000:2.0:1776187969.413792:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.413917:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436736 00000100:00100000:0.0:1776187969.413981:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15551 00000100:00100000:0.0:1776187969.413988:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cd95dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436736:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.414022:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.414118:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:0.0:1776187969.414192:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cd95dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436736:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 203us (407us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.414200:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15551 00000100:00100000:2.0:1776187969.418098:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.418233:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436800 00000100:00100000:3.0:1776187969.418298:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15552 00000100:00100000:3.0:1776187969.418305:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef8984a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436800:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.418354:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.418449:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:3.0:1776187969.418508:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef8984a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436800:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 202us (644us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.418520:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15552 00000100:00100000:2.0:1776187969.423866:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.424033:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436864 00000100:00100000:0.0:1776187969.424087:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15553 00000100:00100000:0.0:1776187969.424093:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009bc6cc5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436864:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.424130:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x234:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.424241:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x234:0x0]: rc = -2 00000100:00100000:0.0:1776187969.424313:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009bc6cc5d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436864:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 218us (456us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.424320:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15553 00000100:00100000:2.0:1776187969.427812:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.427923:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436928 00000100:00100000:3.0:1776187969.427983:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15554 00000100:00100000:3.0:1776187969.427989:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c4fc8fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436928:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.428020:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x234:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.428112:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x234:0x0]: rc = -2 00000100:00100000:3.0:1776187969.428188:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c4fc8fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436928:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 197us (384us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.428196:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15554 00000100:00100000:2.0:1776187969.435663:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.436252:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653436992 00000100:00100000:0.0:1776187969.436321:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15555 00000100:00100000:0.0:1776187969.436328:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000084c31738 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436992:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.436359:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x234:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.436456:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x234:0x0]: rc = -2 00000100:00100000:0.0:1776187969.436518:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000084c31738 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653436992:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 189us (863us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.436526:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15555 00000100:00100000:2.0:1776187969.439282:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.439375:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437056 00000100:00100000:3.0:1776187969.439430:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15556 00000100:00100000:3.0:1776187969.439436:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035e534c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437056:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.439472:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x234:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.439575:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x234:0x0]: rc = -2 00000100:00100000:3.0:1776187969.439644:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035e534c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437056:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 207us (371us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.439651:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15556 00000100:00100000:2.0:1776187969.442842:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.443112:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437120 00000100:00100000:0.0:1776187969.443180:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15557 00000100:00100000:0.0:1776187969.443187:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001673362a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437120:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.443230:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x234:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.443348:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x234:0x0]: rc = -2 00000100:00100000:0.0:1776187969.443405:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001673362a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437120:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 217us (571us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.443412:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15557 00000100:00100000:3.0:1776187969.459762:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.461466:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437184 00000100:00100000:2.0:1776187969.461538:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15558 00000100:00100000:2.0:1776187969.461545:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcbe5f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437184:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.461578:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x234:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.461680:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x234:0x0]: rc = -2 00000100:00100000:2.0:1776187969.461748:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcbe5f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437184:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 203us (1997us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.461756:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15558 00000100:00100000:3.0:1776187969.468793:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.470045:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437248 00000100:00100000:1.0:1776187969.470112:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15559 00000100:00100000:1.0:1776187969.470119:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e144210c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437248:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.470163:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.470265:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187969.470366:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e144210c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437248:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 246us (1582us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.470374:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15559 00000100:00100000:3.0:1776187969.475733:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.476032:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437312 00000100:00100000:0.0:1776187969.476103:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15560 00000100:00100000:0.0:1776187969.476110:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e13c69aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437312:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.476181:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.476278:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:0.0:1776187969.476350:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e13c69aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437312:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 239us (624us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.476357:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15560 00000100:00100000:0.0:1776187969.487563:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.487658:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437376 00000100:00100000:3.0:1776187969.487728:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15561 00000100:00100000:3.0:1776187969.487736:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004db8712a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437376:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.487801:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.488424:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:3.0:1776187969.488542:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004db8712a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437376:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 804us (987us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.488551:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15561 00000100:00100000:1.0:1776187969.505437:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.505533:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437440 00000100:00100000:0.0:1776187969.505623:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15562 00000100:00100000:0.0:1776187969.505631:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2a12fe1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437440:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.505666:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.505781:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:0.0:1776187969.505850:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2a12fe1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437440:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 219us (419us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.505858:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15562 00000100:00100000:1.0:1776187969.511510:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.512252:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437504 00000100:00100000:3.0:1776187969.512324:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15563 00000100:00100000:3.0:1776187969.512331:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c57b803b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437504:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.512365:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x26d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.512468:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x26d:0x0]: rc = -2 00000100:00100000:3.0:1776187969.512539:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c57b803b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437504:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 208us (1037us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.512548:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15563 00000100:00100000:1.0:1776187969.516682:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.516835:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437568 00000100:00100000:3.0:1776187969.516912:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15564 00000100:00100000:3.0:1776187969.516919:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f732f2c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437568:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.517433:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x26d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.517534:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x26d:0x0]: rc = -2 00000100:00100000:3.0:1776187969.517604:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f732f2c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437568:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 683us (928us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.517613:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15564 00000100:00100000:2.0:1776187969.523014:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.523124:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437632 00000100:00100000:1.0:1776187969.523191:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15565 00000100:00100000:1.0:1776187969.523199:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4788ffe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437632:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.523256:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.523368:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187969.523436:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4788ffe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437632:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 237us (431us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.523444:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15565 00000100:00100000:3.0:1776187969.527000:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.527108:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437696 00000100:00100000:1.0:1776187969.527182:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15566 00000100:00100000:1.0:1776187969.527189:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8f5ee10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437696:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.527226:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.527337:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187969.527394:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8f5ee10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437696:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 205us (403us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.527403:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15566 00000100:00100000:2.0:1776187969.531092:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.531180:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437760 00000100:00100000:3.0:1776187969.531292:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15567 00000100:00100000:3.0:1776187969.531300:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f522d882 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437760:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.531342:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.531465:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:3.0:1776187969.531536:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f522d882 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437760:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 236us (453us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.531545:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15567 00000100:00100000:2.0:1776187969.538955:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.539066:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437824 00000100:00100000:3.0:1776187969.539126:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15568 00000100:00100000:3.0:1776187969.539133:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfeb8e69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437824:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.539209:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.539315:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:3.0:1776187969.539375:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfeb8e69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437824:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 241us (430us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.539383:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15568 00000100:00100000:2.0:1776187969.546500:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.546744:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437888 00000100:00100000:0.0:1776187969.546816:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15569 00000100:00100000:0.0:1776187969.546824:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d242284 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437888:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.546856:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.546962:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:0.0:1776187969.547027:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d242284 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437888:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 203us (536us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.547036:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15569 00000100:00100000:2.0:1776187969.551645:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.552587:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653437952 00000100:00100000:1.0:1776187969.552655:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15570 00000100:00100000:1.0:1776187969.552662:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c325c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437952:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.552694:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.552868:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187969.552954:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c325c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653437952:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 291us (1319us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.552962:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15570 00000100:00100000:2.0:1776187969.558216:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.558389:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438016 00000100:00100000:1.0:1776187969.558470:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15571 00000100:00100000:1.0:1776187969.558478:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2d9c0b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438016:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.558529:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.558629:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187969.558692:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2d9c0b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438016:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 213us (485us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.558700:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15571 00000100:00100000:0.0:1776187969.565454:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.565516:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438080 00000100:00100000:1.0:1776187969.565572:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15572 00000100:00100000:1.0:1776187969.565578:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438080:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.565611:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.565693:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:1.0:1776187969.565753:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067f57eeb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438080:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 174us (308us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.565761:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15572 00000100:00100000:0.0:1776187969.572014:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.572063:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438144 00000100:00100000:0.0:1776187969.572119:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15573 00000100:00100000:0.0:1776187969.572128:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb672dd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438144:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.572178:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.572935:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:0.0:1776187969.572992:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb672dd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438144:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 864us (988us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.573002:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15573 00000100:00100000:0.0:1776187969.575570:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.575618:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438208 00000100:00100000:0.0:1776187969.575673:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15574 00000100:00100000:0.0:1776187969.575679:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003032ea0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438208:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.575711:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.575800:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:0.0:1776187969.575849:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003032ea0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438208:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 168us (287us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.575856:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15574 00000001:00080000:2.0:1776187969.580070:0:6351:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968195 is committed 00000001:00080000:2.0:1776187969.580220:0:6351:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968134 is committed 00000100:00100000:1.0:1776187969.582436:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.582920:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438272 00000100:00100000:3.0:1776187969.582991:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15575 00000100:00100000:3.0:1776187969.582998:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8214581 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438272:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.583037:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.583150:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:3.0:1776187969.583219:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8214581 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438272:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 220us (790us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.583227:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15575 00000100:00100000:0.0:1776187969.586406:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.586527:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438336 00000100:00100000:2.0:1776187969.586586:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15576 00000100:00100000:2.0:1776187969.586593:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca377c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438336:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.586652:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x210:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.586751:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x210:0x0]: rc = -2 00000100:00100000:2.0:1776187969.586819:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca377c44 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438336:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 225us (422us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.586826:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15576 00000100:00100000:2.0:1776187969.591436:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.591534:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438400 00000100:00100000:0.0:1776187969.591586:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15577 00000100:00100000:0.0:1776187969.591592:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080411f53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438400:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.591628:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.591715:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:0.0:1776187969.591773:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080411f53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438400:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 181us (346us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.591780:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15577 00000100:00100000:1.0:1776187969.594844:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.594908:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438464 00000100:00100000:3.0:1776187969.594962:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15578 00000100:00100000:3.0:1776187969.594969:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030183490 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438464:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.595095:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.595338:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.595442:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030183490 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438464:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 472us (605us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.595451:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15578 00000100:00100000:1.0:1776187969.598374:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.598547:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438528 00000100:00100000:2.0:1776187969.598639:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15579 00000100:00100000:2.0:1776187969.598646:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cc2639a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438528:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.598683:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.598777:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:2.0:1776187969.598838:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cc2639a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438528:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 192us (473us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.598845:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15579 00000100:00100000:2.0:1776187969.602600:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.602740:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438592 00000100:00100000:0.0:1776187969.602850:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15580 00000100:00100000:0.0:1776187969.602858:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066f354e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438592:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.602959:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.603175:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.603237:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066f354e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438592:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 379us (647us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.603249:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15580 00000100:00100000:1.0:1776187969.611006:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.611309:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438656 00000100:00100000:2.0:1776187969.611365:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15581 00000100:00100000:2.0:1776187969.611371:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031017d0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438656:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.611407:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.611518:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:2.0:1776187969.611599:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031017d0d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438656:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 226us (601us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.611613:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15581 00000100:00100000:0.0:1776187969.615703:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.615824:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438720 00000100:00100000:1.0:1776187969.615991:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15582 00000100:00100000:1.0:1776187969.615997:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2a2bce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438720:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.616027:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.616103:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.616167:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2a2bce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438720:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 168us (471us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.616174:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15582 00000100:00100000:0.0:1776187969.621855:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.622163:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438784 00000100:00100000:1.0:1776187969.622705:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15583 00000100:00100000:1.0:1776187969.622714:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027970f29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438784:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.622758:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.622845:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.622939:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027970f29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438784:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 225us (1095us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.622947:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15583 00000100:00100000:0.0:1776187969.627923:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.628057:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438848 00000100:00100000:1.0:1776187969.628110:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15584 00000100:00100000:1.0:1776187969.628116:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001774e4d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438848:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.628191:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.628285:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.628338:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001774e4d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438848:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 220us (466us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.628346:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15584 00000100:00100000:0.0:1776187969.638891:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.639285:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438912 00000100:00100000:2.0:1776187969.639355:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15585 00000100:00100000:2.0:1776187969.639362:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffdb5047 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438912:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.639397:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.639500:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:2.0:1776187969.639642:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ffdb5047 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438912:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 280us (6352us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.639651:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15585 00000100:00100000:0.0:1776187969.648909:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.649025:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653438976 00000100:00100000:2.0:1776187969.649079:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15586 00000100:00100000:2.0:1776187969.649085:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000102a405b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438976:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.649155:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.649266:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:2.0:1776187969.649330:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000102a405b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653438976:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 244us (430us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.649339:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15586 00000100:00100000:0.0:1776187969.654198:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.658481:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439040 00000100:00100000:1.0:1776187969.658802:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15587 00000100:00100000:1.0:1776187969.658811:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e10840f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439040:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.658858:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.659080:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.659211:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e10840f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439040:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 400us (5023us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.659219:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15587 00000100:00100000:0.0:1776187969.662567:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.662760:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439104 00000100:00100000:1.0:1776187969.662841:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15588 00000100:00100000:1.0:1776187969.662848:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007868c699 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439104:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.662920:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.663230:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.663375:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007868c699 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439104:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 525us (817us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.663385:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15588 00000100:00100000:0.0:1776187969.669614:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.669731:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439168 00000100:00100000:1.0:1776187969.669810:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15589 00000100:00100000:1.0:1776187969.669817:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f56a741f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439168:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.669860:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.670243:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.670327:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f56a741f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439168:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 508us (723us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.670336:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15589 00000100:00100000:0.0:1776187969.675115:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.675226:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439232 00000100:00100000:1.0:1776187969.675338:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15590 00000100:00100000:1.0:1776187969.675346:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000842e0790 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439232:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.675402:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.675501:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.675568:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000842e0790 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439232:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 222us (463us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.675577:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15590 00000100:00100000:3.0:1776187969.679031:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.680585:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439296 00000100:00100000:2.0:1776187969.680679:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15591 00000100:00100000:2.0:1776187969.680689:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7aa3d8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439296:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.680732:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.681185:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:2.0:1776187969.681267:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7aa3d8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439296:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 578us (2245us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.681276:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15591 00000100:00100000:3.0:1776187969.684486:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187969.684539:0:5515:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439360 00000100:00100000:3.0:1776187969.684586:0:5515:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15592 00000100:00100000:3.0:1776187969.684592:0:5515:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fe5c9b61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:11411:x1862467653439360:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187969.684637:0:5515:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187969.684735:0:5515:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:3.0:1776187969.684795:0:5515:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fe5c9b61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+29:11411:x1862467653439360:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 201us (316us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187969.684803:0:5515:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15592 00000100:00100000:3.0:1776187969.688610:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.689486:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439424 00000100:00100000:2.0:1776187969.689558:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15593 00000100:00100000:2.0:1776187969.689565:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e08d0c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439424:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.689603:0:5517:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.689728:0:5517:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:2.0:1776187969.689797:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e08d0c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439424:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 230us (1203us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.689806:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15593 00000100:00100000:3.0:1776187969.694794:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.695120:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439488 00000100:00100000:0.0:1776187969.695188:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15594 00000100:00100000:0.0:1776187969.695194:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e587155 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439488:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.695238:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.695368:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:0.0:1776187969.695442:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e587155 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439488:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 246us (657us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.695451:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15594 00000100:00100000:2.0:1776187969.700726:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.700852:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439552 00000100:00100000:1.0:1776187969.700950:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15595 00000100:00100000:1.0:1776187969.700958:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003bd4f7d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439552:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.701012:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.701131:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.701221:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003bd4f7d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439552:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 261us (504us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.701229:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15595 00000100:00100000:3.0:1776187969.706225:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.706327:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439616 00000100:00100000:0.0:1776187969.706386:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15596 00000100:00100000:0.0:1776187969.706393:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fbb31ea2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439616:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.706430:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.706526:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:0.0:1776187969.706587:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fbb31ea2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439616:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 194us (370us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.706595:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15596 00000100:00100000:3.0:1776187969.712125:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.712299:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439680 00000100:00100000:1.0:1776187969.712353:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15597 00000100:00100000:1.0:1776187969.712360:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d81b363c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439680:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.712394:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.712501:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.712568:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d81b363c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439680:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 208us (459us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.712575:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15597 00000100:00100000:2.0:1776187969.724503:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.724639:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439744 00000100:00100000:0.0:1776187969.724706:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15598 00000100:00100000:0.0:1776187969.724714:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c0f5dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439744:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.724771:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.724872:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:0.0:1776187969.725014:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c0f5dbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439744:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 299us (521us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.725022:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15598 00000100:00100000:3.0:1776187969.739321:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.742993:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439808 00000100:00100000:1.0:1776187969.743190:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15599 00000100:00100000:1.0:1776187969.743199:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088bac792 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439808:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.743237:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.743352:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.743429:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088bac792 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439808:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 230us (4114us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.743437:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15599 00000100:00100000:3.0:1776187969.751769:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.751866:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439872 00000100:00100000:1.0:1776187969.751946:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15600 00000100:00100000:1.0:1776187969.751953:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000783ba691 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439872:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.752013:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.752113:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.752181:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000783ba691 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439872:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 228us (420us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.752188:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15600 00000100:00100000:2.0:1776187969.757553:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.757643:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653439936 00000100:00100000:1.0:1776187969.757820:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15601 00000100:00100000:1.0:1776187969.757835:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c6fe787 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439936:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.757901:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.758013:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.758089:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c6fe787 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653439936:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 261us (545us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.758097:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15601 00000100:00100000:3.0:1776187969.762426:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.762637:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440000 00000100:00100000:1.0:1776187969.762712:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15602 00000100:00100000:1.0:1776187969.762718:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab63205d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440000:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.762754:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.762842:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.763327:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab63205d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440000:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 607us (909us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.763338:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15602 00000100:00100000:3.0:1776187969.770459:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.771008:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440064 00000100:00100000:1.0:1776187969.771070:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15603 00000100:00100000:1.0:1776187969.771077:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd946725 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440064:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.771112:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.771244:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.771325:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd946725 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440064:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 248us (874us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.771333:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15603 00000100:00100000:3.0:1776187969.777811:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.778213:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440128 00000100:00100000:1.0:1776187969.778270:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15604 00000100:00100000:1.0:1776187969.778285:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b84092ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440128:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.778340:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.778458:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.778533:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b84092ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440128:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 255us (733us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.778542:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15604 00000100:00100000:3.0:1776187969.782856:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.783103:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440192 00000100:00100000:1.0:1776187969.783165:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15605 00000100:00100000:1.0:1776187969.783173:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009843b542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440192:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.783206:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.783311:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.783366:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009843b542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440192:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 192us (519us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.783377:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15605 00000100:00100000:3.0:1776187969.788468:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.788567:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440256 00000100:00100000:1.0:1776187969.788656:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15606 00000100:00100000:1.0:1776187969.788663:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005c014c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440256:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.788705:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.788810:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.788909:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005c014c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440256:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 245us (452us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.788917:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15606 00000100:00100000:3.0:1776187969.794974:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.795105:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440320 00000100:00100000:0.0:1776187969.795185:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15607 00000100:00100000:0.0:1776187969.795194:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079db4840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440320:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.795235:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.795364:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:0.0:1776187969.795431:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079db4840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440320:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 236us (469us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.795438:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15607 00000100:00100000:3.0:1776187969.799564:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.799681:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440384 00000100:00100000:1.0:1776187969.799748:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15608 00000100:00100000:1.0:1776187969.799757:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0c5b0da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440384:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.799794:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.799941:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.800024:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0c5b0da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440384:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 266us (469us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.800031:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15608 00000100:00100000:3.0:1776187969.806722:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.812477:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440448 00000100:00100000:0.0:1776187969.812583:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15609 00000100:00100000:0.0:1776187969.812593:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a797ad35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440448:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.812640:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.812739:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:0.0:1776187969.812822:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a797ad35 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440448:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 231us (6111us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.812838:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15609 00000100:00100000:2.0:1776187969.822946:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.823013:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440512 00000100:00100000:0.0:1776187969.823075:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15610 00000100:00100000:0.0:1776187969.823082:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c351f25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440512:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.823115:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.823237:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:0.0:1776187969.823312:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c351f25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440512:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 229us (375us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.823320:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15610 00000100:00100000:3.0:1776187969.829075:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.829352:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440576 00000100:00100000:1.0:1776187969.829405:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15611 00000100:00100000:1.0:1776187969.829412:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000746e089 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440576:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.829485:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.829584:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.829664:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000746e089 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440576:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 251us (597us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.829676:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15611 00000100:00100000:3.0:1776187969.838761:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.838915:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440640 00000100:00100000:0.0:1776187969.838965:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15612 00000100:00100000:0.0:1776187969.838971:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ba054c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440640:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.839034:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.839135:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:0.0:1776187969.839209:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ba054c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440640:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 237us (458us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.839217:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15612 00000100:00100000:2.0:1776187969.844930:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.845221:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440704 00000100:00100000:1.0:1776187969.845286:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15613 00000100:00100000:1.0:1776187969.845294:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2d995be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440704:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.845330:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.845426:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:1.0:1776187969.845495:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2d995be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440704:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 201us (575us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.845504:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15613 00000100:00100000:3.0:1776187969.849585:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.849773:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440768 00000100:00100000:0.0:1776187969.849909:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15614 00000100:00100000:0.0:1776187969.849918:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000375acdb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440768:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.849955:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.850047:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21b:0x0]: rc = -2 00000100:00100000:0.0:1776187969.850117:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000375acdb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440768:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 199us (541us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.850125:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15614 00000100:00100000:3.0:1776187969.855483:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.856033:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440832 00000100:00100000:0.0:1776187969.856091:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15615 00000100:00100000:0.0:1776187969.856098:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000149f7589 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440832:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.856131:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.856239:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:0.0:1776187969.856309:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000149f7589 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440832:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 211us (835us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.856317:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15615 00000100:00100000:2.0:1776187969.860476:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.870835:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440896 00000100:00100000:1.0:1776187969.870925:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15616 00000100:00100000:1.0:1776187969.870973:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a0b5af7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440896:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.871012:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.871117:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.871208:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a0b5af7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440896:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 275us (10742us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.876848:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15616 00000100:00100000:3.0:1776187969.884202:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.886277:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653440960 00000100:00100000:2.0:1776187969.886454:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15617 00000100:00100000:2.0:1776187969.886463:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b14af352 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440960:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.886502:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.886627:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:2.0:1776187969.886709:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b14af352 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653440960:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 246us (2517us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.886717:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15617 00000100:00100000:3.0:1776187969.889826:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.889913:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441024 00000100:00100000:0.0:1776187969.889966:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15618 00000100:00100000:0.0:1776187969.889973:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073553ead pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441024:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.890009:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.890119:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:0.0:1776187969.890192:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073553ead pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441024:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 218us (374us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.890201:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15618 00000100:00100000:3.0:1776187969.896253:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.896419:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441088 00000100:00100000:2.0:1776187969.896471:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15619 00000100:00100000:2.0:1776187969.896478:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf7f1d89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441088:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.896537:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23b:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.896640:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23b:0x0]: rc = -2 00000100:00100000:2.0:1776187969.896704:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf7f1d89 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441088:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 226us (465us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.896713:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15619 00000100:00100000:3.0:1776187969.900521:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.900725:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441152 00000100:00100000:0.0:1776187969.900794:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15620 00000100:00100000:0.0:1776187969.900801:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005589373c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441152:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.900871:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.901043:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23b:0x0]: rc = -2 00000100:00100000:0.0:1776187969.901103:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005589373c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441152:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 302us (591us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.901111:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15620 00000100:00100000:3.0:1776187969.908775:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.912629:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441216 00000100:00100000:2.0:1776187969.912706:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15621 00000100:00100000:2.0:1776187969.912713:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f917b6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441216:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.912758:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.912869:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:2.0:1776187969.913298:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f917b6e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441216:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 583us (4529us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.913307:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15621 00000100:00100000:3.0:1776187969.918997:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.922689:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441280 00000100:00100000:2.0:1776187969.922751:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15622 00000100:00100000:2.0:1776187969.922757:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eb9d3d6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441280:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.922793:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.923581:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:2.0:1776187969.923913:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eb9d3d6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441280:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 1115us (4885us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.923927:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15622 00000100:00100000:3.0:1776187969.940030:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.940236:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441344 00000100:00100000:2.0:1776187969.940306:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15623 00000100:00100000:2.0:1776187969.940313:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008fd1dad5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441344:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.940346:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23b:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.940456:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23b:0x0]: rc = -2 00000100:00100000:2.0:1776187969.940527:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008fd1dad5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441344:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 214us (506us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.940537:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15623 00000100:00100000:3.0:1776187969.950022:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.950576:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441408 00000100:00100000:0.0:1776187969.950648:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15624 00000100:00100000:0.0:1776187969.950656:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002467f7d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441408:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.950701:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.950805:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23b:0x0]: rc = -2 00000100:00100000:0.0:1776187969.950910:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002467f7d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441408:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 254us (895us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.950919:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15624 00000100:00100000:3.0:1776187969.965213:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.965580:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441472 00000100:00100000:2.0:1776187969.965655:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15625 00000100:00100000:2.0:1776187969.965663:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d31b3e8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441472:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.965724:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.965821:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:2.0:1776187969.965929:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d31b3e8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441472:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 265us (722us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.965937:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15625 00000100:00100000:3.0:1776187969.976564:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.976701:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441536 00000100:00100000:0.0:1776187969.976766:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15626 00000100:00100000:0.0:1776187969.976773:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c1aac22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441536:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.976809:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.976947:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:0.0:1776187969.977014:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c1aac22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441536:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 240us (459us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.977024:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15626 00000100:00100000:3.0:1776187969.981837:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187969.982827:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441600 00000100:00100000:2.0:1776187969.983125:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15627 00000100:00100000:2.0:1776187969.983142:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025fca930 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441600:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187969.983185:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23b:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187969.983298:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23b:0x0]: rc = -2 00000100:00100000:2.0:1776187969.983366:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025fca930 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441600:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 233us (1538us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187969.983374:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15627 00000100:00100000:3.0:1776187969.986215:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.987422:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441664 00000100:00100000:0.0:1776187969.987492:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15628 00000100:00100000:0.0:1776187969.987499:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca963743 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441664:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.987537:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.987646:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23b:0x0]: rc = -2 00000100:00100000:0.0:1776187969.987705:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca963743 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441664:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 205us (1500us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.987713:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15628 00000100:00100000:3.0:1776187969.990929:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187969.991832:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441728 00000100:00100000:0.0:1776187969.991896:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15629 00000100:00100000:0.0:1776187969.991902:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e059535c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441728:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187969.991953:0:5517:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187969.992061:0:5517:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:0.0:1776187969.992119:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e059535c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441728:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 217us (1202us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187969.992127:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15629 00000100:00100000:3.0:1776187969.996077:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187969.996259:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441792 00000100:00100000:1.0:1776187969.996318:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15630 00000100:00100000:1.0:1776187969.996324:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005359ef33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441792:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187969.996363:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187969.996625:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187969.996706:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005359ef33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441792:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 381us (637us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187969.996721:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15630 00000100:00100000:0.0:1776187970.008417:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.008802:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441856 00000100:00100000:1.0:1776187970.008865:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15631 00000100:00100000:1.0:1776187970.008872:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d1abae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441856:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.008972:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.009068:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187970.009223:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d1abae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441856:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 350us (814us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.009231:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15631 00000100:00100000:3.0:1776187970.016331:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.016848:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441920 00000100:00100000:2.0:1776187970.016949:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15632 00000100:00100000:2.0:1776187970.016956:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000890f1430 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441920:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.016998:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.017126:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:2.0:1776187970.017197:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000890f1430 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441920:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 240us (877us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.017205:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15632 00000100:00100000:3.0:1776187970.023345:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.025858:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653441984 00000100:00100000:1.0:1776187970.026310:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15633 00000100:00100000:1.0:1776187970.026320:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000344f6d72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441984:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.026365:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.026489:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187970.026564:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000344f6d72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653441984:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 243us (3229us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.026573:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15633 00000100:00100000:0.0:1776187970.031977:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.034253:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442048 00000100:00100000:1.0:1776187970.034654:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15634 00000100:00100000:1.0:1776187970.034662:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057ad4e34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442048:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.034701:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.034812:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187970.034912:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057ad4e34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442048:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 249us (2943us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.034921:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15634 00000100:00100000:3.0:1776187970.039109:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.039242:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442112 00000100:00100000:0.0:1776187970.039299:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15635 00000100:00100000:0.0:1776187970.039306:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000927d9240 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442112:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.039346:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.039573:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:0.0:1776187970.039647:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000927d9240 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442112:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 340us (548us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.039655:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15635 00000100:00100000:0.0:1776187970.042690:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.042863:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442176 00000100:00100000:2.0:1776187970.042954:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15636 00000100:00100000:2.0:1776187970.042961:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000013c3909d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442176:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.043145:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.043256:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:2.0:1776187970.043336:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000013c3909d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442176:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 374us (656us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.043345:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15636 00000100:00100000:3.0:1776187970.049942:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.050215:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442240 00000100:00100000:2.0:1776187970.050269:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15637 00000100:00100000:2.0:1776187970.050276:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd82bb7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442240:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.050328:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.050919:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:2.0:1776187970.051391:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd82bb7e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442240:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 1105us (1450us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.051401:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15637 00000100:00100000:3.0:1776187970.055350:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.055820:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442304 00000100:00100000:2.0:1776187970.055870:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15638 00000100:00100000:2.0:1776187970.055912:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083a94df2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442304:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.055943:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.056043:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:2.0:1776187970.056097:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083a94df2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442304:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 185us (756us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.056105:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15638 00000100:00100000:0.0:1776187970.060735:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.061029:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442368 00000100:00100000:3.0:1776187970.061085:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15639 00000100:00100000:3.0:1776187970.061093:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000870140c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442368:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.061150:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.061269:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:3.0:1776187970.061342:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000870140c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442368:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 248us (618us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.061350:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15639 00000100:00100000:3.0:1776187970.066050:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.068089:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442432 00000100:00100000:0.0:1776187970.068280:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15640 00000100:00100000:0.0:1776187970.068288:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052710b4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442432:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.068323:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.068437:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:0.0:1776187970.068510:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052710b4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442432:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 221us (2469us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.068518:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15640 00000100:00100000:1.0:1776187970.073760:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.074251:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442496 00000100:00100000:3.0:1776187970.074552:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15641 00000100:00100000:3.0:1776187970.074559:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071940cea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442496:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.074629:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.074725:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:3.0:1776187970.074794:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071940cea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442496:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 234us (1042us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.074803:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15641 00000100:00100000:0.0:1776187970.078586:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.078694:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442560 00000100:00100000:2.0:1776187970.078762:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15642 00000100:00100000:2.0:1776187970.078769:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d86a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442560:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.078801:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.078930:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:2.0:1776187970.078991:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d86a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442560:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 221us (413us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.079000:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15642 00000100:00100000:2.0:1776187970.085991:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.086488:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442624 00000100:00100000:1.0:1776187970.086552:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15643 00000100:00100000:1.0:1776187970.086558:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000779852bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442624:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.086592:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.086693:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:1.0:1776187970.086754:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000779852bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442624:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 194us (771us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.086762:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15643 00000100:00100000:0.0:1776187970.090152:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.090355:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442688 00000100:00100000:3.0:1776187970.090450:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15644 00000100:00100000:3.0:1776187970.090458:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a36f99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442688:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.090495:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.090621:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:3.0:1776187970.090687:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a36f99 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442688:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 228us (541us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.090695:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15644 00000100:00100000:3.0:1776187970.096262:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.096334:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442752 00000100:00100000:3.0:1776187970.096406:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15645 00000100:00100000:3.0:1776187970.096414:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000894dc1df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442752:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.096454:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.096726:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:3.0:1776187970.096798:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000894dc1df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442752:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 382us (546us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.096807:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15645 00000100:00100000:2.0:1776187970.107289:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.107368:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442816 00000100:00100000:3.0:1776187970.107526:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15646 00000100:00100000:3.0:1776187970.107533:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005a57e104 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442816:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.107568:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.107764:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:3.0:1776187970.107903:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005a57e104 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442816:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 369us (634us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.107912:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15646 00000100:00100000:1.0:1776187970.115783:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.116149:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442880 00000100:00100000:0.0:1776187970.116233:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15647 00000100:00100000:0.0:1776187970.116240:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000267f7899 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442880:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.116285:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.116561:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:0.0:1776187970.116674:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000267f7899 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442880:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 433us (900us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.116683:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15647 00000100:00100000:3.0:1776187970.120336:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.120562:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653442944 00000100:00100000:2.0:1776187970.120745:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15648 00000100:00100000:2.0:1776187970.120752:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f42d7af2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442944:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.120784:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x244:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.120901:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x244:0x0]: rc = -2 00000100:00100000:2.0:1776187970.120959:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f42d7af2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653442944:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 207us (634us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.120978:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15648 00000100:00100000:2.0:1776187970.126256:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.126813:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443008 00000100:00100000:1.0:1776187970.126904:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15649 00000100:00100000:1.0:1776187970.126912:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4fde9e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443008:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.126970:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.127065:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:1.0:1776187970.127141:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4fde9e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443008:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 220us (886us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.127150:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15649 00000100:00100000:3.0:1776187970.132337:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.132664:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443072 00000100:00100000:0.0:1776187970.132759:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15650 00000100:00100000:0.0:1776187970.132766:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077c3b583 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443072:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.132829:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.132963:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:0.0:1776187970.133024:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077c3b583 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443072:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 257us (698us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.133032:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15650 00000100:00100000:3.0:1776187970.139412:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.140083:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443136 00000100:00100000:1.0:1776187970.140197:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15651 00000100:00100000:1.0:1776187970.140205:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006439688d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443136:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.140237:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.140363:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:1.0:1776187970.140450:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006439688d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443136:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 244us (1051us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.140459:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15651 00000100:00100000:2.0:1776187970.149839:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.150810:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443200 00000100:00100000:3.0:1776187970.150983:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15652 00000100:00100000:3.0:1776187970.150990:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000434de27e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443200:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.151048:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.151152:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:3.0:1776187970.151247:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000434de27e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443200:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 256us (1419us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.151255:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15652 00000100:00100000:2.0:1776187970.159304:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.162108:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443264 00000100:00100000:3.0:1776187970.162219:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15653 00000100:00100000:3.0:1776187970.162227:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000716acfad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443264:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.162262:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.162388:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:3.0:1776187970.162463:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000716acfad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443264:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 236us (3171us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.162470:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15653 00000100:00100000:1.0:1776187970.177273:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.177397:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443328 00000100:00100000:3.0:1776187970.177458:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15654 00000100:00100000:3.0:1776187970.177464:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b868b2a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443328:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.177505:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.177612:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:3.0:1776187970.177687:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b868b2a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443328:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 221us (422us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.177696:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15654 00000100:00100000:2.0:1776187970.200520:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.200696:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443392 00000100:00100000:0.0:1776187970.200749:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15655 00000100:00100000:0.0:1776187970.200756:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bdbacb78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443392:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.200791:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.200941:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:0.0:1776187970.200997:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bdbacb78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443392:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 240us (487us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.201005:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15655 00000100:00100000:2.0:1776187970.205605:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.206724:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443456 00000100:00100000:3.0:1776187970.206817:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15656 00000100:00100000:3.0:1776187970.206826:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df71c72b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443456:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.207220:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20f:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.207950:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20f:0x0]: rc = -2 00000100:00100000:2.0:1776187970.208051:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df71c72b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443456:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 1222us (2452us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.208061:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15656 00000100:00100000:1.0:1776187970.226071:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.226215:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443520 00000100:00100000:2.0:1776187970.226282:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15657 00000100:00100000:2.0:1776187970.226290:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000096f226c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443520:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.226361:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.226453:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:2.0:1776187970.226516:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000096f226c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443520:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 225us (461us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.226523:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15657 00000100:00100000:2.0:1776187970.238280:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.239689:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443584 00000100:00100000:0.0:1776187970.239768:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15658 00000100:00100000:0.0:1776187970.239775:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c66df1af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443584:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.239812:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.241161:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:1.0:1776187970.241249:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c66df1af pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443584:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 1471us (2975us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.241260:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15658 00000100:00100000:3.0:1776187970.247708:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.249780:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443648 00000100:00100000:1.0:1776187970.250463:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15659 00000100:00100000:1.0:1776187970.250473:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000843473e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443648:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.250509:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.250758:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20a:0x0]: rc = -2 00000100:00100000:1.0:1776187970.251152:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000843473e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443648:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 679us (3449us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.251161:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15659 00000100:00100000:3.0:1776187970.262252:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.262535:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443712 00000100:00100000:1.0:1776187970.262612:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15660 00000100:00100000:1.0:1776187970.262620:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003b43327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443712:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.262654:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.262751:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20a:0x0]: rc = -2 00000100:00100000:1.0:1776187970.262814:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003b43327 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443712:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 194us (571us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.262822:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15660 00000100:00100000:2.0:1776187970.269204:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.269333:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443776 00000100:00100000:0.0:1776187970.269390:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15661 00000100:00100000:0.0:1776187970.269397:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d204502 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443776:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.269432:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.269527:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1776187970.269594:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d204502 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443776:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 195us (397us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.269602:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15661 00000100:00100000:3.0:1776187970.275110:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.275202:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443840 00000100:00100000:0.0:1776187970.275259:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15662 00000100:00100000:0.0:1776187970.275266:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc7c6b96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443840:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.275336:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x20a:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.275438:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x20a:0x0]: rc = -2 00000100:00100000:0.0:1776187970.275500:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc7c6b96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443840:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 234us (398us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.275509:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15662 00000100:00100000:3.0:1776187970.278982:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.279289:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443904 00000100:00100000:0.0:1776187970.279338:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15663 00000100:00100000:0.0:1776187970.279344:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020131072 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443904:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.279378:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.279478:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:0.0:1776187970.279533:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020131072 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443904:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 188us (559us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.279541:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15663 00000100:00100000:2.0:1776187970.283338:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.283424:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653443968 00000100:00100000:0.0:1776187970.283487:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15664 00000100:00100000:0.0:1776187970.283494:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e7f160e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443968:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.283526:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.283617:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:0.0:1776187970.283684:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e7f160e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653443968:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 189us (362us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.283692:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15664 00000100:00100000:3.0:1776187970.296277:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.296347:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444032 00000100:00100000:0.0:1776187970.296409:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15665 00000100:00100000:0.0:1776187970.296416:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd0dbaa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444032:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.296447:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.296546:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:0.0:1776187970.296611:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd0dbaa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444032:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 194us (350us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.296619:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15665 00000100:00100000:3.0:1776187970.301522:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.302610:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444096 00000100:00100000:1.0:1776187970.302678:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15666 00000100:00100000:1.0:1776187970.302685:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006789db94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444096:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.302744:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.302846:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:1.0:1776187970.302968:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006789db94 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444096:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 282us (1455us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.302977:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15666 00000100:00100000:2.0:1776187970.306865:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.307103:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444160 00000100:00100000:0.0:1776187970.307170:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15667 00000100:00100000:0.0:1776187970.307177:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e207269 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444160:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.307237:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.307336:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:0.0:1776187970.307388:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e207269 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444160:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 210us (530us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.307397:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15667 00000100:00100000:3.0:1776187970.310029:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.310194:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444224 00000100:00100000:1.0:1776187970.310247:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15668 00000100:00100000:1.0:1776187970.310253:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014f0d83d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444224:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.310286:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.310382:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:1.0:1776187970.310443:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014f0d83d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444224:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 189us (421us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.310451:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15668 00000100:00100000:3.0:1776187970.315039:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.315436:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444288 00000100:00100000:0.0:1776187970.315486:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15669 00000100:00100000:0.0:1776187970.315492:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000230b7dd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444288:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.315525:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.315619:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.315684:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000230b7dd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444288:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 190us (653us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.315692:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15669 00000100:00100000:2.0:1776187970.320309:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.320396:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444352 00000100:00100000:1.0:1776187970.320455:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15670 00000100:00100000:1.0:1776187970.320466:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004db8bea4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444352:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.320502:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.320592:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:1.0:1776187970.320652:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004db8bea4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444352:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 185us (352us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.320660:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15670 00000100:00100000:3.0:1776187970.323992:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.324178:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444416 00000100:00100000:2.0:1776187970.324242:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15671 00000100:00100000:2.0:1776187970.324250:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6cedb7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444416:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.324292:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.324397:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:2.0:1776187970.324470:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6cedb7a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444416:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 219us (491us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.324478:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15671 00000100:00100000:3.0:1776187970.329102:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.329233:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444480 00000100:00100000:2.0:1776187970.329295:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15672 00000100:00100000:2.0:1776187970.329302:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008873d140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444480:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.329335:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.329440:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:2.0:1776187970.329489:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008873d140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444480:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 187us (395us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.329497:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15672 00000100:00100000:3.0:1776187970.339531:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.340205:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444544 00000100:00100000:1.0:1776187970.340271:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15673 00000100:00100000:1.0:1776187970.340279:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000873e8b1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444544:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.340315:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.340411:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:1.0:1776187970.340479:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000873e8b1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444544:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 199us (954us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.340488:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15673 00000100:00100000:3.0:1776187970.345027:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.345142:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444608 00000100:00100000:2.0:1776187970.345203:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15674 00000100:00100000:2.0:1776187970.345210:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000305ca8f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444608:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.345245:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.345352:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.345414:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000305ca8f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444608:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 202us (404us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.345423:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15674 00000100:00100000:3.0:1776187970.354622:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.355201:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444672 00000100:00100000:2.0:1776187970.355263:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15675 00000100:00100000:2.0:1776187970.355269:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000036845b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444672:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.355325:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.355423:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:2.0:1776187970.355486:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000036845b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444672:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 215us (871us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.355494:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15675 00000100:00100000:3.0:1776187970.362662:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.362910:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444736 00000100:00100000:2.0:1776187970.362974:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15676 00000100:00100000:2.0:1776187970.362981:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005467921f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444736:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.363029:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.363136:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:2.0:1776187970.363206:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005467921f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444736:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 224us (554us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.363214:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15676 00000100:00100000:3.0:1776187970.372053:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.372257:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444800 00000100:00100000:1.0:1776187970.372317:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15677 00000100:00100000:1.0:1776187970.372324:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093f1ba7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444800:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.372383:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.372495:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:1.0:1776187970.372565:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093f1ba7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444800:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 240us (520us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.372574:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15677 00000100:00100000:3.0:1776187970.376998:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.377419:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444864 00000100:00100000:2.0:1776187970.377487:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15678 00000100:00100000:2.0:1776187970.377495:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000226d82a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444864:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.377533:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.377644:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.377712:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000226d82a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444864:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 216us (721us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.377719:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15678 00000100:00100000:3.0:1776187970.381592:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.381946:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444928 00000100:00100000:1.0:1776187970.382221:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15679 00000100:00100000:1.0:1776187970.382230:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a205269b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444928:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.382273:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.382370:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:1.0:1776187970.382433:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a205269b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444928:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 202us (853us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.384907:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15679 00000100:00100000:3.0:1776187970.386388:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.386466:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653444992 00000100:00100000:1.0:1776187970.386556:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15680 00000100:00100000:1.0:1776187970.386563:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6e3f9b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444992:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.386614:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.386734:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:1.0:1776187970.386804:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6e3f9b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653444992:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 240us (421us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.386815:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15680 00000100:00100000:3.0:1776187970.391139:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.391824:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445056 00000100:00100000:1.0:1776187970.391927:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15681 00000100:00100000:1.0:1776187970.391992:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e3eea26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445056:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.392095:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.392234:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:1.0:1776187970.392421:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e3eea26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445056:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 428us (1300us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.392430:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15681 00000100:00100000:3.0:1776187970.395847:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.395993:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445120 00000100:00100000:1.0:1776187970.396056:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15682 00000100:00100000:1.0:1776187970.396063:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a69f0109 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445120:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.396138:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.396247:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:1.0:1776187970.396526:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a69f0109 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445120:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 462us (687us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.396535:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15682 00000100:00100000:2.0:1776187970.401486:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.401578:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445184 00000100:00100000:1.0:1776187970.401640:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15683 00000100:00100000:1.0:1776187970.401647:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a622cdd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445184:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.401682:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.401775:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:1.0:1776187970.401838:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a622cdd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445184:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 190us (360us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.401849:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15683 00000100:00100000:3.0:1776187970.404984:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.405087:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445248 00000100:00100000:2.0:1776187970.405151:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15684 00000100:00100000:2.0:1776187970.405158:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000801ad508 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445248:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.405193:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.405299:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.405358:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000801ad508 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445248:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 199us (391us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.405366:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15684 00010000:00010000:0.0:1776187970.408177:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187970.411296:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.411398:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445312 00000100:00100000:1.0:1776187970.411455:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15685 00000100:00100000:1.0:1776187970.411461:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8bb2b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445312:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.411496:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.411591:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:1.0:1776187970.411662:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8bb2b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445312:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 200us (374us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.411670:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15685 00000100:00100000:3.0:1776187970.414642:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.414739:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445376 00000100:00100000:2.0:1776187970.414798:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15686 00000100:00100000:2.0:1776187970.414804:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025c80208 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445376:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.414862:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.415003:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:2.0:1776187970.415062:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025c80208 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445376:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 256us (427us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.415069:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15686 00000100:00100000:3.0:1776187970.418567:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.418676:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445440 00000100:00100000:1.0:1776187970.418752:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15687 00000100:00100000:1.0:1776187970.418759:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ccb7994 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445440:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.418800:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.420176:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:0.0:1776187970.420324:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ccb7994 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445440:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 1560us (1762us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.420345:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15687 00000100:00100000:3.0:1776187970.423681:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.425018:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445504 00000100:00100000:0.0:1776187970.425181:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15688 00000100:00100000:0.0:1776187970.425188:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9fb81cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445504:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.425223:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.425330:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:0.0:1776187970.425395:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9fb81cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445504:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 207us (1724us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.425403:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15688 00000100:00100000:3.0:1776187970.427969:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.428384:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445568 00000100:00100000:0.0:1776187970.428446:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15689 00000100:00100000:0.0:1776187970.428454:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005134e194 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445568:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.428491:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.428582:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.428653:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005134e194 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445568:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 198us (695us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.428661:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15689 00000100:00100000:1.0:1776187970.431044:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.431143:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445632 00000100:00100000:3.0:1776187970.431206:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15690 00000100:00100000:3.0:1776187970.431212:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000648348c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445632:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.431269:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.431357:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:3.0:1776187970.431422:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000648348c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445632:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 208us (384us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.431430:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15690 00000100:00100000:1.0:1776187970.434634:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.435000:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445696 00000100:00100000:0.0:1776187970.435050:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15691 00000100:00100000:0.0:1776187970.435056:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001331024b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445696:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.435113:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.435220:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:0.0:1776187970.435285:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001331024b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445696:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 227us (658us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.435297:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15691 00000100:00100000:2.0:1776187970.439535:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.439623:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445760 00000100:00100000:3.0:1776187970.439680:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15692 00000100:00100000:3.0:1776187970.439686:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005860330a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445760:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.439718:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x21c:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.439805:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x21c:0x0]: rc = -2 00000100:00100000:3.0:1776187970.439903:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005860330a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445760:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 186us (345us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.439915:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15692 00000100:00100000:1.0:1776187970.444094:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.444218:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445824 00000100:00100000:0.0:1776187970.444282:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15693 00000100:00100000:0.0:1776187970.444289:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085aafe65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445824:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.444321:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.444414:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.444474:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085aafe65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445824:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 184us (388us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.444482:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15693 00000100:00100000:1.0:1776187970.447800:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.447916:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445888 00000100:00100000:3.0:1776187970.447986:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15694 00000100:00100000:3.0:1776187970.447993:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000058e89d9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445888:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.448030:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.448144:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:3.0:1776187970.448201:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000058e89d9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445888:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 207us (408us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.448208:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15694 00000100:00100000:3.0:1776187970.452978:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.453174:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653445952 00000100:00100000:0.0:1776187970.453228:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15695 00000100:00100000:0.0:1776187970.453234:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b5402d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445952:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.453267:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.453360:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.453421:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b5402d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653445952:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 186us (450us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.453429:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15695 00000100:00100000:1.0:1776187970.456815:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.457068:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446016 00000100:00100000:2.0:1776187970.457199:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15696 00000100:00100000:2.0:1776187970.457207:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfd4dd14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446016:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.457243:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.457344:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.457405:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfd4dd14 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446016:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 197us (597us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.457414:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15696 00000100:00100000:1.0:1776187970.461236:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.462034:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446080 00000100:00100000:0.0:1776187970.462096:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15697 00000100:00100000:0.0:1776187970.462107:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fdb2febe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446080:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.462190:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23c:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.462337:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23c:0x0]: rc = -2 00000100:00100000:0.0:1776187970.462431:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fdb2febe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446080:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 323us (1202us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.462442:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15697 00000100:00100000:3.0:1776187970.464481:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.464563:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446144 00000100:00100000:0.0:1776187970.464615:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15698 00000100:00100000:0.0:1776187970.464621:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8ea53aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446144:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.464675:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23c:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.464765:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23c:0x0]: rc = -2 00000100:00100000:0.0:1776187970.464821:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8ea53aa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446144:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 198us (346us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.464829:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15698 00000100:00100000:1.0:1776187970.467654:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.469167:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446208 00000100:00100000:3.0:1776187970.469298:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15699 00000100:00100000:3.0:1776187970.469306:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d626ca28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446208:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.469342:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.469432:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:3.0:1776187970.469504:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d626ca28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446208:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 198us (1857us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.469511:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15699 00000100:00100000:1.0:1776187970.475916:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.476054:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446272 00000100:00100000:3.0:1776187970.476115:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15700 00000100:00100000:3.0:1776187970.476121:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ab07dd8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446272:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.476194:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.476301:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:3.0:1776187970.476417:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ab07dd8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446272:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 295us (508us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.476426:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15700 00000100:00100000:0.0:1776187970.480866:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.481341:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446336 00000100:00100000:3.0:1776187970.481404:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15701 00000100:00100000:3.0:1776187970.481413:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043c5c2b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446336:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.481447:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23c:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.481547:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23c:0x0]: rc = -2 00000100:00100000:3.0:1776187970.481810:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043c5c2b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446336:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 397us (957us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.481820:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15701 00000100:00100000:2.0:1776187970.485004:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.485148:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446400 00000100:00100000:3.0:1776187970.485217:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15702 00000100:00100000:3.0:1776187970.485226:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd034c8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446400:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.485280:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23c:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.485388:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23c:0x0]: rc = -2 00000100:00100000:3.0:1776187970.485445:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd034c8e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446400:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 219us (451us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.485453:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15702 00000100:00100000:1.0:1776187970.489139:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.489610:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446464 00000100:00100000:0.0:1776187970.489671:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15703 00000100:00100000:0.0:1776187970.489678:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000742e830a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446464:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.489712:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.489804:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.489947:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000742e830a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446464:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 268us (828us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.489955:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15703 00000100:00100000:0.0:1776187970.502739:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.502853:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446528 00000100:00100000:1.0:1776187970.502954:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15704 00000100:00100000:1.0:1776187970.502961:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4912074 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446528:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.503239:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.503335:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:1.0:1776187970.503407:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4912074 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446528:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 444us (675us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.503414:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15704 00000100:00100000:2.0:1776187970.511841:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.512070:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446592 00000100:00100000:3.0:1776187970.512155:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15705 00000100:00100000:3.0:1776187970.512163:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc81a111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446592:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.512210:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23c:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.512341:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23c:0x0]: rc = -2 00000100:00100000:3.0:1776187970.512421:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc81a111 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446592:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 257us (590us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.512433:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15705 00000100:00100000:2.0:1776187970.517818:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.517920:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446656 00000100:00100000:1.0:1776187970.517996:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15706 00000100:00100000:1.0:1776187970.518005:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b46b3a06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446656:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.518047:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x23c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.519540:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x23c:0x0]: rc = -2 00000100:00100000:1.0:1776187970.519622:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b46b3a06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446656:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 1616us (1811us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.519633:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15706 00000100:00100000:0.0:1776187970.525073:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.525339:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446720 00000100:00100000:1.0:1776187970.525413:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15707 00000100:00100000:1.0:1776187970.525420:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000776008e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446720:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.525455:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.525545:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:1.0:1776187970.525611:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000776008e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446720:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 190us (545us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.525619:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15707 00000100:00100000:2.0:1776187970.533169:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.534110:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446784 00000100:00100000:3.0:1776187970.534188:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15708 00000100:00100000:3.0:1776187970.534195:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017f05a73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446784:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.534255:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.534353:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:3.0:1776187970.534428:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017f05a73 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446784:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 232us (1265us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.534437:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15708 00000100:00100000:2.0:1776187970.538394:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.538574:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446848 00000100:00100000:3.0:1776187970.538749:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15709 00000100:00100000:3.0:1776187970.538756:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbe52803 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446848:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.538822:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.538991:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:3.0:1776187970.539070:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbe52803 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446848:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 313us (687us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.539079:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15709 00000100:00100000:1.0:1776187970.544933:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.545599:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446912 00000100:00100000:3.0:1776187970.545662:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15710 00000100:00100000:3.0:1776187970.545669:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bd32cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446912:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.545718:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.545829:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.547584:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bd32cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446912:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 1907us (2653us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.547600:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15710 00000100:00100000:2.0:1776187970.555136:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.555255:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653446976 00000100:00100000:0.0:1776187970.555315:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15711 00000100:00100000:0.0:1776187970.555323:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e4613a69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446976:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.555363:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.555461:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.555532:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e4613a69 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653446976:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 209us (415us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.555541:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15711 00000100:00100000:1.0:1776187970.565504:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.565783:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447040 00000100:00100000:0.0:1776187970.565855:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15712 00000100:00100000:0.0:1776187970.565862:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097e5f9d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447040:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.565947:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.566063:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.566116:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097e5f9d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447040:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 255us (622us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.566135:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15712 00000100:00100000:3.0:1776187970.571194:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.572249:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447104 00000100:00100000:0.0:1776187970.572326:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15713 00000100:00100000:0.0:1776187970.572334:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000813fe89a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447104:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.572396:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x209:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.572493:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x209:0x0]: rc = -2 00000100:00100000:0.0:1776187970.572560:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000813fe89a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447104:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 226us (1375us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.572568:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15713 00000100:00100000:1.0:1776187970.579268:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.579369:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447168 00000100:00100000:0.0:1776187970.579455:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15714 00000100:00100000:0.0:1776187970.579463:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098884104 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447168:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.579503:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x209:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.579611:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x209:0x0]: rc = -2 00000100:00100000:0.0:1776187970.579674:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098884104 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447168:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 211us (415us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.579684:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15714 00000100:00100000:3.0:1776187970.582411:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.582522:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447232 00000100:00100000:2.0:1776187970.582583:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15715 00000100:00100000:2.0:1776187970.582590:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008adfc18b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447232:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.582637:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.582732:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.582794:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008adfc18b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447232:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 203us (391us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.582801:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15715 00000100:00100000:3.0:1776187970.586247:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.586341:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447296 00000100:00100000:0.0:1776187970.586432:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15716 00000100:00100000:0.0:1776187970.586439:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d2c560 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447296:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.586474:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.586567:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.586635:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d2c560 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447296:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 195us (397us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.586643:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15716 00000100:00100000:1.0:1776187970.590928:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.592412:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447360 00000100:00100000:2.0:1776187970.592484:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15717 00000100:00100000:2.0:1776187970.592492:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8941b51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447360:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.592531:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x209:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.592666:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x209:0x0]: rc = -2 00000100:00100000:2.0:1776187970.592748:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8941b51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447360:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 256us (1829us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.592758:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15717 00000100:00100000:1.0:1776187970.599559:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.599808:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447424 00000100:00100000:3.0:1776187970.599926:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15718 00000100:00100000:3.0:1776187970.599933:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf35614f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447424:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.599965:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x209:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.600073:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x209:0x0]: rc = -2 00000100:00100000:3.0:1776187970.600142:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf35614f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447424:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 208us (593us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.600150:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15718 00000100:00100000:2.0:1776187970.605718:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.605957:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447488 00000100:00100000:3.0:1776187970.606025:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15719 00000100:00100000:3.0:1776187970.606031:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f1860e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447488:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.606093:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.606207:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:3.0:1776187970.606292:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f1860e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447488:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 259us (582us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.606300:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15719 00000100:00100000:1.0:1776187970.611283:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.611542:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447552 00000100:00100000:2.0:1776187970.611617:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15720 00000100:00100000:2.0:1776187970.611625:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000afa39ead pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447552:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.611680:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.611774:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.611832:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000afa39ead pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447552:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 207us (571us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.611840:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15720 00000100:00100000:0.0:1776187970.616276:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.616448:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447616 00000100:00100000:3.0:1776187970.616510:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15721 00000100:00100000:3.0:1776187970.616518:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d89ed77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447616:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.616555:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x233:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.616782:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x233:0x0]: rc = -2 00000100:00100000:3.0:1776187970.616897:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d89ed77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447616:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 378us (640us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.616905:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15721 00000100:00100000:1.0:1776187970.622422:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.622538:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447680 00000100:00100000:3.0:1776187970.622800:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15722 00000100:00100000:3.0:1776187970.622808:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef529192 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447680:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.622841:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x233:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.622952:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x233:0x0]: rc = -2 00000100:00100000:3.0:1776187970.623026:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef529192 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447680:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 219us (614us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.623034:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15722 00000100:00100000:2.0:1776187970.629245:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.629484:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447744 00000100:00100000:3.0:1776187970.629578:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15723 00000100:00100000:3.0:1776187970.629586:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000168460a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447744:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.629638:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.629732:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:3.0:1776187970.629838:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000168460a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447744:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 251us (602us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.629846:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15723 00000100:00100000:0.0:1776187970.635012:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.635404:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447808 00000100:00100000:3.0:1776187970.635474:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15724 00000100:00100000:3.0:1776187970.635481:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b518a13a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447808:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.635546:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.635816:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:3.0:1776187970.635940:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b518a13a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447808:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 458us (936us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.635949:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15724 00000100:00100000:1.0:1776187970.642171:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.642387:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447872 00000100:00100000:3.0:1776187970.642490:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15725 00000100:00100000:3.0:1776187970.642497:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010802825 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447872:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.642533:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x233:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.642679:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x233:0x0]: rc = -2 00000100:00100000:3.0:1776187970.642757:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010802825 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447872:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 259us (594us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.642765:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15725 00000100:00100000:2.0:1776187970.647535:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.647847:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653447936 00000100:00100000:3.0:1776187970.647938:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15726 00000100:00100000:3.0:1776187970.647946:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000517fc29b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447936:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.647999:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x233:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.648104:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x233:0x0]: rc = -2 00000100:00100000:3.0:1776187970.648184:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000517fc29b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653447936:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 238us (658us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.648194:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15726 00000100:00100000:0.0:1776187970.652496:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.653153:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448000 00000100:00100000:2.0:1776187970.653380:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15727 00000100:00100000:2.0:1776187970.653388:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d15dfbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448000:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.653429:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.653519:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.653581:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d15dfbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448000:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 193us (1093us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.653595:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15727 00000100:00100000:3.0:1776187970.657141:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.659175:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448064 00000100:00100000:1.0:1776187970.659270:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15728 00000100:00100000:1.0:1776187970.659280:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094ba7718 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448064:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.659318:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.659414:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:1.0:1776187970.659483:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094ba7718 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448064:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 203us (2363us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.659490:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15728 00000100:00100000:2.0:1776187970.665272:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.665425:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448128 00000100:00100000:0.0:1776187970.665488:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15729 00000100:00100000:0.0:1776187970.665494:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014e42aac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448128:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.665526:0:5517:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x233:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.665641:0:5517:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x233:0x0]: rc = -2 00000100:00100000:0.0:1776187970.665703:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014e42aac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448128:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 208us (451us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.665711:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15729 00000100:00100000:3.0:1776187970.673992:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.674112:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448192 00000100:00100000:2.0:1776187970.674175:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15730 00000100:00100000:2.0:1776187970.674182:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e9a71b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448192:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.674217:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x233:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.674325:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x233:0x0]: rc = -2 00000100:00100000:2.0:1776187970.674380:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e9a71b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448192:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 198us (396us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.674388:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15730 00000100:00100000:3.0:1776187970.678362:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.678520:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448256 00000100:00100000:0.0:1776187970.678579:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15731 00000100:00100000:0.0:1776187970.678586:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ec4cfd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448256:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.678662:0:5517:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.678768:0:5517:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.678824:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ec4cfd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448256:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 237us (470us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.678832:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15731 00000100:00100000:3.0:1776187970.686821:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.688191:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448320 00000100:00100000:2.0:1776187970.688306:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15732 00000100:00100000:2.0:1776187970.688313:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061378dda pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448320:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.688357:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.688490:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.688569:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061378dda pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448320:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 255us (1756us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.688578:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15732 00000100:00100000:3.0:1776187970.692614:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.692818:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448384 00000100:00100000:1.0:1776187970.692910:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15733 00000100:00100000:1.0:1776187970.692917:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7827538 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448384:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.692975:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.693072:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:1.0:1776187970.693149:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7827538 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448384:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 231us (548us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.693157:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15733 00000100:00100000:3.0:1776187970.697279:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.697927:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448448 00000100:00100000:2.0:1776187970.697990:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15734 00000100:00100000:2.0:1776187970.697997:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448448:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.698056:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.698165:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.698304:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de6f4da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448448:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 305us (1043us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.698311:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15734 00000100:00100000:1.0:1776187970.705224:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.705453:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448512 00000100:00100000:3.0:1776187970.705565:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15735 00000100:00100000:3.0:1776187970.705574:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a15b397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448512:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.705766:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.706037:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:3.0:1776187970.706167:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a15b397 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448512:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 593us (954us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.706181:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15735 00000100:00100000:1.0:1776187970.710563:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.710809:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448576 00000100:00100000:3.0:1776187970.710963:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15736 00000100:00100000:3.0:1776187970.711054:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008599647e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448576:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.711129:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.711227:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:3.0:1776187970.711426:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008599647e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448576:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 372us (871us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.711434:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15736 00000100:00100000:0.0:1776187970.716622:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.716768:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448640 00000100:00100000:3.0:1776187970.716828:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15737 00000100:00100000:3.0:1776187970.716836:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079b86e0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448640:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.716871:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.717026:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:3.0:1776187970.717097:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079b86e0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448640:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 260us (491us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.717105:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15737 00000100:00100000:1.0:1776187970.722392:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.722492:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448704 00000100:00100000:2.0:1776187970.722545:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15738 00000100:00100000:2.0:1776187970.722552:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000416f053d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448704:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.722597:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.722700:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:2.0:1776187970.722761:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000416f053d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448704:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 209us (376us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.722769:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15738 00000100:00100000:1.0:1776187970.729087:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.729187:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448768 00000100:00100000:3.0:1776187970.729245:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15739 00000100:00100000:3.0:1776187970.729252:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ba2a942 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448768:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.729296:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.729388:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:3.0:1776187970.729472:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ba2a942 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448768:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 219us (392us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.729483:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15739 00000100:00100000:0.0:1776187970.732848:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.733418:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448832 00000100:00100000:2.0:1776187970.733513:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15740 00000100:00100000:2.0:1776187970.733520:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077da40a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448832:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.733555:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.733680:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:2.0:1776187970.733789:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077da40a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448832:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 269us (951us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.733798:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15740 00000100:00100000:1.0:1776187970.739463:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.742764:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448896 00000100:00100000:0.0:1776187970.743142:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15741 00000100:00100000:0.0:1776187970.743150:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac4564e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448896:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.743186:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.743295:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:0.0:1776187970.743370:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac4564e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448896:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 219us (3916us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.743379:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15741 00000100:00100000:1.0:1776187970.746968:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.747093:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653448960 00000100:00100000:3.0:1776187970.747160:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15742 00000100:00100000:3.0:1776187970.747167:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038f7f86b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448960:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.747203:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.747310:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:3.0:1776187970.747530:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038f7f86b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653448960:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 362us (571us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.747539:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15742 00000100:00100000:1.0:1776187970.753283:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.754166:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449024 00000100:00100000:0.0:1776187970.754282:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15743 00000100:00100000:0.0:1776187970.754290:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057a9741d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449024:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.754328:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.754425:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.754489:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057a9741d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449024:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 198us (1224us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.754498:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15743 00000100:00100000:2.0:1776187970.759005:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.759293:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449088 00000100:00100000:0.0:1776187970.759351:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15744 00000100:00100000:0.0:1776187970.759357:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b64ac501 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449088:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.759394:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x243:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.759495:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x243:0x0]: rc = -2 00000100:00100000:0.0:1776187970.759546:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b64ac501 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449088:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 188us (548us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.759554:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15744 00000100:00100000:1.0:1776187970.764818:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.766132:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449152 00000100:00100000:2.0:1776187970.766490:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15745 00000100:00100000:2.0:1776187970.766499:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000072e8d4bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449152:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.766544:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.766814:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:2.0:1776187970.766907:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000072e8d4bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449152:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 407us (2096us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.766915:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15745 00000100:00100000:1.0:1776187970.770365:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.770459:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449216 00000100:00100000:2.0:1776187970.770545:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15746 00000100:00100000:2.0:1776187970.770552:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000949a869a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449216:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.770628:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x202:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.770718:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x202:0x0]: rc = -2 00000100:00100000:2.0:1776187970.770777:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000949a869a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449216:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 223us (422us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.770786:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15746 00000100:00100000:1.0:1776187970.774133:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.774493:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449280 00000100:00100000:2.0:1776187970.774538:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15747 00000100:00100000:2.0:1776187970.774544:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080eb653b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449280:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.774577:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x26e:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.774686:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x26e:0x0]: rc = -2 00000100:00100000:2.0:1776187970.774764:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080eb653b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449280:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 218us (649us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.774774:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15747 00000100:00100000:1.0:1776187970.777550:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.778087:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449344 00000100:00100000:0.0:1776187970.778211:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15748 00000100:00100000:0.0:1776187970.778219:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044bfd0ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449344:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.778286:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x26e:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.778382:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x26e:0x0]: rc = -2 00000100:00100000:0.0:1776187970.778448:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044bfd0ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449344:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 228us (906us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.778456:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15748 00000100:00100000:1.0:1776187970.784244:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.784417:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449408 00000100:00100000:2.0:1776187970.784476:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15749 00000100:00100000:2.0:1776187970.784484:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000890f5647 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449408:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.784523:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x272:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.784631:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x272:0x0]: rc = -2 00000100:00100000:2.0:1776187970.784691:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000890f5647 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449408:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 207us (456us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.784699:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15749 00000100:00100000:1.0:1776187970.788004:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.788082:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449472 00000100:00100000:0.0:1776187970.788143:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15750 00000100:00100000:0.0:1776187970.788151:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1aba4ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449472:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.788182:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x272:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.788291:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x272:0x0]: rc = -2 00000100:00100000:0.0:1776187970.788353:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1aba4ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449472:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 202us (486us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.788362:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15750 00000100:00100000:1.0:1776187970.794433:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.794785:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449536 00000100:00100000:2.0:1776187970.794844:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15751 00000100:00100000:2.0:1776187970.794852:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040696a39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449536:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.794906:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.795013:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:2.0:1776187970.795076:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040696a39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449536:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 223us (653us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.795084:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15751 00000100:00100000:1.0:1776187970.799513:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.799775:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449600 00000100:00100000:0.0:1776187970.799868:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15752 00000100:00100000:0.0:1776187970.799916:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000351b54b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449600:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.799952:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.800056:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:0.0:1776187970.800113:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000351b54b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449600:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 238us (608us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.800135:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15752 00000100:00100000:1.0:1776187970.804979:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.805475:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449664 00000100:00100000:2.0:1776187970.805527:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15753 00000100:00100000:2.0:1776187970.805533:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b20ab5eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449664:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.805601:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.805694:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:2.0:1776187970.805957:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b20ab5eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449664:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 423us (1000us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.805977:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15753 00000100:00100000:3.0:1776187970.815440:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.815544:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449728 00000100:00100000:0.0:1776187970.815623:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15754 00000100:00100000:0.0:1776187970.815630:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bead27ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449728:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.815668:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.815761:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:0.0:1776187970.815827:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bead27ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449728:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 197us (397us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.815836:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15754 00000100:00100000:2.0:1776187970.820667:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.820760:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449792 00000100:00100000:0.0:1776187970.820821:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15755 00000100:00100000:0.0:1776187970.820828:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008865b48e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449792:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.820919:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x272:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.821028:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x272:0x0]: rc = -2 00000100:00100000:0.0:1776187970.821080:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008865b48e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449792:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 251us (422us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.821088:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15755 00000100:00100000:3.0:1776187970.825276:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.825818:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449856 00000100:00100000:2.0:1776187970.826108:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15756 00000100:00100000:2.0:1776187970.826126:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d3cb9e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449856:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.826167:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x272:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.826273:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x272:0x0]: rc = -2 00000100:00100000:2.0:1776187970.826381:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d3cb9e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449856:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 264us (1123us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.826389:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15756 00000100:00100000:3.0:1776187970.829745:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.829933:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449920 00000100:00100000:0.0:1776187970.829981:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15757 00000100:00100000:0.0:1776187970.829988:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066529f31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449920:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.830019:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.830110:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:0.0:1776187970.830180:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066529f31 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449920:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 191us (442us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.830192:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15757 00000100:00100000:1.0:1776187970.834609:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.834691:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653449984 00000100:00100000:2.0:1776187970.834754:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15758 00000100:00100000:2.0:1776187970.834762:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5028f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449984:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.834809:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.834964:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:2.0:1776187970.835037:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5028f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653449984:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 274us (450us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.835046:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15758 00000100:00100000:3.0:1776187970.839627:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.839806:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450048 00000100:00100000:1.0:1776187970.839855:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15759 00000100:00100000:1.0:1776187970.839862:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ddaf998f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450048:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.839931:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.840027:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:1.0:1776187970.840084:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ddaf998f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450048:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 221us (467us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.840092:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15759 00000100:00100000:3.0:1776187970.846355:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.846466:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450112 00000100:00100000:2.0:1776187970.846525:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15760 00000100:00100000:2.0:1776187970.846532:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000046fcb93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450112:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.846568:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.846683:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:2.0:1776187970.846752:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000046fcb93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450112:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 218us (404us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.846761:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15760 00000100:00100000:3.0:1776187970.861713:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.862031:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450176 00000100:00100000:1.0:1776187970.862095:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15761 00000100:00100000:1.0:1776187970.862101:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c697eec4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450176:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.862144:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x272:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.862242:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x272:0x0]: rc = -2 00000100:00100000:1.0:1776187970.862300:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c697eec4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450176:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 198us (595us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.862312:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15761 00000100:00100000:3.0:1776187970.873692:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.873938:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450240 00000100:00100000:2.0:1776187970.873998:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15762 00000100:00100000:2.0:1776187970.874005:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cab47b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450240:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.874062:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x272:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.874166:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x272:0x0]: rc = -2 00000100:00100000:2.0:1776187970.874223:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cab47b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450240:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 217us (539us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.874231:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15762 00000100:00100000:3.0:1776187970.881230:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.881361:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450304 00000100:00100000:1.0:1776187970.881429:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15763 00000100:00100000:1.0:1776187970.881435:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070ebc396 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450304:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.881469:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.881563:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:1.0:1776187970.881637:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070ebc396 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450304:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 200us (418us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.881645:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15763 00000100:00100000:3.0:1776187970.886290:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.887048:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450368 00000100:00100000:2.0:1776187970.887150:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15764 00000100:00100000:2.0:1776187970.887161:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057ec2aa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450368:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187970.887204:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x201:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187970.887320:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x201:0x0]: rc = -2 00000100:00100000:2.0:1776187970.887394:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057ec2aa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450368:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 234us (1112us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187970.887403:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15764 00000100:00100000:3.0:1776187970.890861:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.891709:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450432 00000100:00100000:1.0:1776187970.891775:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15765 00000100:00100000:1.0:1776187970.891783:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049e513ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450432:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.891843:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.891992:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:1.0:1776187970.892061:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049e513ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450432:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 278us (1209us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.892070:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15765 00000100:00100000:3.0:1776187970.895675:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.895851:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450496 00000100:00100000:0.0:1776187970.895937:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15766 00000100:00100000:0.0:1776187970.895944:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006a4217b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450496:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.895978:0:12471:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.896069:0:12471:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:0.0:1776187970.896139:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a4217b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450496:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 194us (472us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.896147:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15766 00000100:00100000:3.0:1776187970.900854:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187970.902478:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450560 00000100:00100000:3.0:1776187970.902819:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15767 00000100:00100000:3.0:1776187970.902827:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093a34e6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450560:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.903006:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x271:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.903110:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x271:0x0]: rc = -2 00000100:00100000:3.0:1776187970.903229:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093a34e6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450560:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 400us (2382us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.903237:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15767 00000100:00100000:3.0:1776187970.906655:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.906991:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450624 00000100:00100000:1.0:1776187970.907049:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15768 00000100:00100000:1.0:1776187970.907056:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8eddfe4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450624:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.907087:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x271:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.907182:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x271:0x0]: rc = -2 00000100:00100000:1.0:1776187970.907240:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8eddfe4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450624:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 184us (593us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.907252:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15768 00000100:00100000:0.0:1776187970.914033:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.914974:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450688 00000100:00100000:3.0:1776187970.915071:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15769 00000100:00100000:3.0:1776187970.915078:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000896208e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450688:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.915113:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x271:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.915212:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x271:0x0]: rc = -2 00000100:00100000:3.0:1776187970.915288:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000896208e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450688:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 208us (1261us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.915296:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15769 00000100:00100000:0.0:1776187970.924419:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.924949:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450752 00000100:00100000:3.0:1776187970.925081:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15770 00000100:00100000:3.0:1776187970.925090:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078ed3625 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450752:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.925138:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x271:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.925232:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x271:0x0]: rc = -2 00000100:00100000:3.0:1776187970.925302:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078ed3625 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450752:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 211us (893us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.925309:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15770 00000100:00100000:0.0:1776187970.932638:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.933308:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450816 00000100:00100000:3.0:1776187970.933373:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15771 00000100:00100000:3.0:1776187970.933380:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c4d5713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450816:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.933421:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x271:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.933520:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x271:0x0]: rc = -2 00000100:00100000:3.0:1776187970.933573:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c4d5713 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450816:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 192us (945us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.933581:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15771 00000100:00100000:0.0:1776187970.942516:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.942640:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450880 00000100:00100000:1.0:1776187970.942701:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15772 00000100:00100000:1.0:1776187970.942708:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f4c75a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450880:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.942745:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x271:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.942854:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x271:0x0]: rc = -2 00000100:00100000:1.0:1776187970.942938:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f4c75a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450880:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 229us (430us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.942946:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15772 00000100:00100000:0.0:1776187970.949908:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.950085:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653450944 00000100:00100000:3.0:1776187970.950149:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15773 00000100:00100000:3.0:1776187970.950155:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1f10cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450944:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187970.950206:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f4:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187970.950301:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f4:0x0]: rc = -2 00000100:00100000:3.0:1776187970.950357:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1f10cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653450944:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 200us (456us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187970.950364:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15773 00000100:00100000:3.0:1776187970.959617:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187970.959717:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451008 00000100:00100000:1.0:1776187970.959787:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15774 00000100:00100000:1.0:1776187970.959793:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e6ba762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451008:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.959825:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.959959:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f4:0x0]: rc = -2 00000100:00100000:1.0:1776187970.960016:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e6ba762 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451008:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 222us (406us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.960024:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15774 00000100:00100000:0.0:1776187970.963865:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187970.966225:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451072 00000100:00100000:0.0:1776187970.966487:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15775 00000100:00100000:0.0:1776187970.966495:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451072:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.966530:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.966858:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f4:0x0]: rc = -2 00000100:00100000:0.0:1776187970.966954:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ccf39a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451072:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 458us (3096us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.966963:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15775 00000100:00100000:2.0:1776187970.984256:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.984519:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451136 00000100:00100000:0.0:1776187970.984637:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15776 00000100:00100000:0.0:1776187970.984644:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1d4e17d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451136:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187970.984710:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187970.984821:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f4:0x0]: rc = -2 00000100:00100000:0.0:1776187970.984925:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1d4e17d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451136:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 279us (677us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187970.984934:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15776 00000100:00100000:3.0:1776187970.997477:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187970.997822:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451200 00000100:00100000:1.0:1776187970.997984:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15777 00000100:00100000:1.0:1776187970.997992:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d4e344b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451200:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187970.998053:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187970.998157:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f4:0x0]: rc = -2 00000100:00100000:1.0:1776187970.998306:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d4e344b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451200:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 314us (836us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187970.998314:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15777 00000100:00100000:3.0:1776187971.011097:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187971.011170:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451264 00000100:00100000:1.0:1776187971.011239:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15778 00000100:00100000:1.0:1776187971.011246:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090b78af5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451264:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187971.011296:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187971.011404:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f4:0x0]: rc = -2 00000100:00100000:1.0:1776187971.011475:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090b78af5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451264:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 228us (386us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187971.011483:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15778 00000100:00100000:2.0:1776187971.020689:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.020831:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451328 00000100:00100000:0.0:1776187971.020944:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15779 00000100:00100000:0.0:1776187971.020951:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006117bfa8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451328:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.020998:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.021095:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f4:0x0]: rc = -2 00000100:00100000:0.0:1776187971.021175:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006117bfa8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451328:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 223us (498us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.021184:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15779 00000100:00100000:0.0:1776187971.036439:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187971.036519:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451392 00000100:00100000:1.0:1776187971.036575:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15780 00000100:00100000:1.0:1776187971.036581:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef5c0c7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451392:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187971.036613:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187971.036707:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f4:0x0]: rc = -2 00000100:00100000:1.0:1776187971.036765:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef5c0c7d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451392:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 183us (333us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187971.036773:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15780 00000100:00100000:3.0:1776187971.046698:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.046850:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451456 00000100:00100000:0.0:1776187971.046941:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15781 00000100:00100000:0.0:1776187971.046948:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2d0ceec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451456:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.046982:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.047073:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.047145:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2d0ceec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451456:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 196us (456us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.047153:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15781 00000100:00100000:2.0:1776187971.057173:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187971.061160:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451520 00000100:00100000:0.0:1776187971.061252:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15782 00000100:00100000:0.0:1776187971.061261:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000817e4933 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451520:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.061301:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.061408:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.061488:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000817e4933 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451520:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 227us (4324us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.061496:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15782 00000100:00100000:3.0:1776187971.067598:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.067692:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451584 00000100:00100000:0.0:1776187971.067750:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15783 00000100:00100000:0.0:1776187971.067757:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a482f139 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451584:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.067820:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.067971:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.068035:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a482f139 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451584:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 277us (445us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.068043:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15783 00000100:00100000:3.0:1776187971.075609:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.075847:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451648 00000100:00100000:0.0:1776187971.075946:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15784 00000100:00100000:0.0:1776187971.075953:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b166f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451648:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.075990:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.076092:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.076165:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b166f79 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451648:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 211us (564us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.076174:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15784 00000100:00100000:2.0:1776187971.084705:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.084835:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451712 00000100:00100000:0.0:1776187971.084924:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15785 00000100:00100000:0.0:1776187971.084931:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ba04817 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451712:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.084963:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.085073:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.085152:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ba04817 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451712:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 219us (454us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.085159:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15785 00000100:00100000:3.0:1776187971.092067:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187971.092201:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451776 00000100:00100000:2.0:1776187971.092274:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15786 00000100:00100000:2.0:1776187971.092281:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d12b55ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451776:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187971.092317:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187971.092524:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:2.0:1776187971.092821:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d12b55ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451776:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 538us (761us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187971.092830:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15786 00000100:00100000:3.0:1776187971.099718:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187971.099841:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451840 00000100:00100000:2.0:1776187971.100712:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15787 00000100:00100000:2.0:1776187971.100720:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000140b6540 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451840:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187971.100757:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187971.100853:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:2.0:1776187971.101167:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000140b6540 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451840:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 446us (1462us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187971.101177:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15787 00000100:00100000:3.0:1776187971.105868:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.106961:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451904 00000100:00100000:0.0:1776187971.107035:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15788 00000100:00100000:0.0:1776187971.107042:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9d60ddf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451904:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.107082:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.107184:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.107247:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9d60ddf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451904:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 205us (1388us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.107262:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15788 00000100:00100000:3.0:1776187971.112822:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187971.112987:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653451968 00000100:00100000:1.0:1776187971.113054:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15789 00000100:00100000:1.0:1776187971.113061:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c5172b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451968:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187971.113100:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187971.113207:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:1.0:1776187971.113272:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c5172b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653451968:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 210us (459us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187971.113280:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15789 00000100:00100000:3.0:1776187971.118202:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.118337:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452032 00000100:00100000:0.0:1776187971.118414:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15790 00000100:00100000:0.0:1776187971.118424:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000793c3b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452032:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.118520:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.118656:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.118729:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000793c3b0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452032:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 305us (541us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.118738:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15790 00000100:00100000:2.0:1776187971.125743:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187971.125862:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452096 00000100:00100000:1.0:1776187971.125961:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15791 00000100:00100000:1.0:1776187971.125969:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d76a0226 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452096:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187971.126032:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187971.126137:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:1.0:1776187971.126195:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d76a0226 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452096:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 225us (465us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187971.126202:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15791 00000100:00100000:3.0:1776187971.130856:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.131208:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452160 00000100:00100000:0.0:1776187971.131275:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15792 00000100:00100000:0.0:1776187971.131284:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c6422bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452160:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.131324:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.131428:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.131510:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c6422bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452160:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 225us (661us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.131519:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15792 00000100:00100000:3.0:1776187971.141060:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187971.141359:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452224 00000100:00100000:1.0:1776187971.141445:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15793 00000100:00100000:1.0:1776187971.141453:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000261b4fd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452224:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1776187971.141490:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1776187971.141593:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:1.0:1776187971.141653:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000261b4fd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452224:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 199us (599us total) trans 0 rc -2/-2 00000100:00100000:1.0:1776187971.141661:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15793 00000100:00100000:3.0:1776187971.147765:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187971.147923:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452288 00000100:00100000:2.0:1776187971.147983:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15794 00000100:00100000:2.0:1776187971.147991:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000965161d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452288:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187971.148056:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187971.148166:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:2.0:1776187971.148224:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000965161d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452288:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 233us (471us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187971.148232:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15794 00000100:00100000:3.0:1776187971.155199:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.155824:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452352 00000100:00100000:0.0:1776187971.155907:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15795 00000100:00100000:0.0:1776187971.155914:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e72b87f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452352:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.155946:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.156035:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.156083:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e72b87f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452352:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 169us (895us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.156091:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15795 00000100:00100000:2.0:1776187971.160569:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.160772:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452416 00000100:00100000:3.0:1776187971.160832:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15796 00000100:00100000:3.0:1776187971.160839:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000805b708d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452416:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.160905:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.161003:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:3.0:1776187971.161062:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000805b708d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452416:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 223us (501us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.161070:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15796 00000100:00100000:3.0:1776187971.166085:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.166363:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452480 00000100:00100000:0.0:1776187971.166447:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15797 00000100:00100000:0.0:1776187971.166455:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c90e0dec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452480:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.166494:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.166602:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.166667:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c90e0dec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452480:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 212us (792us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.166675:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15797 00000100:00100000:2.0:1776187971.171013:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.171212:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452544 00000100:00100000:0.0:1776187971.171278:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15798 00000100:00100000:0.0:1776187971.171285:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a3ceb8d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452544:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.171351:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.171499:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f5:0x0]: rc = -2 00000100:00100000:0.0:1776187971.171583:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a3ceb8d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452544:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 292us (574us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.171596:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15798 00000100:00100000:2.0:1776187971.177958:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.178221:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452608 00000100:00100000:3.0:1776187971.178387:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15799 00000100:00100000:3.0:1776187971.178396:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd3821b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452608:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.178438:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.178548:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:3.0:1776187971.178638:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd3821b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452608:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 242us (687us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.178646:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15799 00000100:00100000:2.0:1776187971.183176:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.183264:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452672 00000100:00100000:3.0:1776187971.183339:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15800 00000100:00100000:3.0:1776187971.183347:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000217ef172 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452672:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.183392:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.183490:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f3:0x0]: rc = -2 00000100:00100000:3.0:1776187971.183549:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000217ef172 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452672:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 202us (381us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.183557:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15800 00000100:00100000:2.0:1776187971.187688:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.187782:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452736 00000100:00100000:0.0:1776187971.187840:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15801 00000100:00100000:0.0:1776187971.187846:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002be731d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452736:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.187909:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.188158:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f1:0x0]: rc = -2 00000100:00100000:0.0:1776187971.188223:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002be731d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452736:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 376us (542us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.188232:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15801 00000100:00100000:2.0:1776187971.191485:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.191588:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452800 00000100:00100000:0.0:1776187971.191649:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15802 00000100:00100000:0.0:1776187971.191656:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020025a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452800:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.191704:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.191820:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f1:0x0]: rc = -2 00000100:00100000:0.0:1776187971.192160:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020025a1b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452800:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 502us (687us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.192169:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15802 00000100:00100000:2.0:1776187971.197275:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.197424:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452864 00000100:00100000:0.0:1776187971.197482:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15803 00000100:00100000:0.0:1776187971.197489:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010c377d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452864:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.197524:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.197631:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:0.0:1776187971.197690:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010c377d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452864:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 200us (425us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.197700:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15803 00000100:00100000:2.0:1776187971.200782:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.201187:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452928 00000100:00100000:2.0:1776187971.201304:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15804 00000100:00100000:2.0:1776187971.201311:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045ecf174 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452928:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187971.201343:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187971.201436:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:2.0:1776187971.201497:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045ecf174 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452928:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 185us (723us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187971.201505:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15804 00000100:00100000:2.0:1776187971.204750:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187971.204847:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653452992 00000100:00100000:0.0:1776187971.204929:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15805 00000100:00100000:0.0:1776187971.204936:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045eb0318 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452992:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1776187971.204994:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1776187971.205106:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:0.0:1776187971.205179:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045eb0318 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653452992:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 242us (438us total) trans 0 rc -2/-2 00000100:00100000:0.0:1776187971.205188:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15805 00000100:00100000:3.0:1776187971.208493:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187971.208594:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453056 00000100:00100000:2.0:1776187971.208644:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15806 00000100:00100000:2.0:1776187971.208652:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000320f707c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453056:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187971.208694:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187971.208801:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:2.0:1776187971.208866:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000320f707c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453056:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 213us (380us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187971.208895:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15806 00000100:00100000:0.0:1776187971.218435:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.218674:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453120 00000100:00100000:3.0:1776187971.218738:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15807 00000100:00100000:3.0:1776187971.218746:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037547e6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453120:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.218804:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.218946:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:3.0:1776187971.219010:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037547e6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453120:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 262us (583us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.219018:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15807 00000100:00100000:3.0:1776187971.222747:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187971.222857:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453184 00000100:00100000:2.0:1776187971.222942:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15808 00000100:00100000:2.0:1776187971.222949:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026ee736a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453184:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187971.222995:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187971.223093:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:2.0:1776187971.223161:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026ee736a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453184:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 212us (425us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187971.223170:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15808 00000100:00100000:0.0:1776187971.227282:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.227439:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453248 00000100:00100000:3.0:1776187971.227497:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15809 00000100:00100000:3.0:1776187971.227503:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d9b6c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453248:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.227537:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.227640:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:3.0:1776187971.227711:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d9b6c26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453248:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 207us (436us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.227720:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15809 00000100:00100000:0.0:1776187971.231661:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187971.231820:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453312 00000100:00100000:2.0:1776187971.231904:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15810 00000100:00100000:2.0:1776187971.231911:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e9d400a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453312:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187971.231965:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187971.232069:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:2.0:1776187971.232134:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e9d400a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453312:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 222us (480us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187971.232142:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15810 00000100:00100000:0.0:1776187971.236488:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.236582:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453376 00000100:00100000:3.0:1776187971.236640:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15811 00000100:00100000:3.0:1776187971.236647:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f18ed5c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453376:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.236683:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.236776:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:3.0:1776187971.236834:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f18ed5c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453376:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 187us (356us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.236842:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15811 00000100:00100000:0.0:1776187971.240283:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187971.240398:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453440 00000100:00100000:2.0:1776187971.240453:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15812 00000100:00100000:2.0:1776187971.240460:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c0cad1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453440:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187971.240496:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187971.240602:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:2.0:1776187971.240666:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c0cad1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453440:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 205us (394us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187971.240674:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15812 00000100:00100000:0.0:1776187971.244848:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.245228:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453504 00000100:00100000:3.0:1776187971.245302:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15813 00000100:00100000:3.0:1776187971.245309:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b38f14a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453504:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.245344:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.245437:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:3.0:1776187971.245498:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b38f14a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453504:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 189us (658us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.245506:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15813 00000100:00100000:0.0:1776187971.248434:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187971.248518:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453568 00000100:00100000:2.0:1776187971.248574:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15814 00000100:00100000:2.0:1776187971.248590:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080ece517 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453568:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1776187971.248621:0:6573:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1776187971.248712:0:6573:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:2.0:1776187971.248771:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080ece517 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453568:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 181us (346us total) trans 0 rc -2/-2 00000100:00100000:2.0:1776187971.248778:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15814 00000100:00100000:0.0:1776187971.252014:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.252592:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453632 00000100:00100000:3.0:1776187971.252773:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15815 00000100:00100000:3.0:1776187971.252781:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d560593c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453632:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.252848:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.252964:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:3.0:1776187971.253049:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d560593c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453632:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 268us (1047us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.253057:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15815 00000100:00100000:0.0:1776187971.260149:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.260284:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453696 00000100:00100000:3.0:1776187971.260340:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15816 00000100:00100000:3.0:1776187971.260347:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009cba992e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453696:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.260380:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.260474:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:3.0:1776187971.260726:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009cba992e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453696:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 377us (584us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.260734:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15816 00000100:00100000:1.0:1776187971.265477:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.265565:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453760 00000100:00100000:3.0:1776187971.265763:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15817 00000100:00100000:3.0:1776187971.265770:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb204951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453760:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.265814:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.265920:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:3.0:1776187971.265999:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb204951 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453760:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 228us (529us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.266007:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15817 00000100:00100000:0.0:1776187971.269233:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187971.269404:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453824 00000100:00100000:3.0:1776187971.269501:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15818 00000100:00100000:3.0:1776187971.269509:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9a365fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453824:12345-192.168.204.20@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1776187971.269542:0:5516:0:(mdt_handler.c:7215:mdt_fid2path()) path get [0x200000401:0x1f6:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1776187971.269642:0:5516:0:(mdt_handler.c:7257:mdt_fid2path()) nonlocal object [0x200000401:0x1f6:0x0]: rc = -2 00000100:00100000:3.0:1776187971.269706:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9a365fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:11411:x1862467653453824:12345-192.168.204.20@tcp:53:lustre_rsync.0 Request processed in 197us (482us total) trans 0 rc -2/-2 00000100:00100000:3.0:1776187971.269714:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15818 00010000:00010000:3.0:1776187971.432056:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187971.496345:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:1.0:1776187971.496438:0:7290:0:(osp_sync.c:1658:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 448480562231ns, next at 449480560130ns, rc = 0 00000100:00100000:1.0:1776187971.496482:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003642cc65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659912896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1776187971.496550:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187971.496625:0:7603:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659912896 00000100:00100000:1.0:1776187971.496668:0:7603:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1776187971.496675:0:7603:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074e0543b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+65:2995:x1862467659912896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1776187971.496715:0:7603:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 17039360 granted 272564224 pending 0 free 3807379456 avail 3805282304 00000100:00100000:1.0:1776187971.496754:0:7603:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074e0543b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+65:2995:x1862467659912896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187971.496764:0:7603:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1776187971.496814:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003642cc65 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659912896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1776187971.497054:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1776187971.497063:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000714c2236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2995:1862467659912960:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1776187971.497091:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187971.497140:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659912960 00000100:00100000:1.0:1776187971.497168:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1776187971.497171:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003642cc65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2995:x1862467659912960:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1776187971.497205:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003642cc65 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2995:x1862467659912960:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187971.497211:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1776187971.497233:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000714c2236 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2995:1862467659912960:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1776187971.498174:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187971.498191:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db4ef2c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2994:1862467659913024:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1776187971.498242:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187971.498660:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913024 00000100:00100000:1.0:1776187971.498710:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1776187971.498715:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7a5e45b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1862467659913024:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1776187971.498758:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7a5e45b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2994:x1862467659913024:12345-0@lo:400:kworker/u8:0.0 Request processed in 42us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187971.498764:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1776187971.498835:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db4ef2c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2994:1862467659913024:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1776187971.499188:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c2de1de4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:124909f8-d332-49c6-a146-b122e3595f63:2993:1862467659912832:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1776187971.499224:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187971.499285:0:5508:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659912832 00000100:00100000:0.0:1776187971.499320:0:5508:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1776187971.499324:0:5508:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edec7c1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124909f8-d332-49c6-a146-b122e3595f63+18:2993:x1862467659912832:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1776187971.499359:0:5508:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edec7c1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124909f8-d332-49c6-a146-b122e3595f63+18:2993:x1862467659912832:12345-0@lo:400:kworker/u8:0.0 Request processed in 34us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187971.499364:0:5508:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1776187971.499452:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c2de1de4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:124909f8-d332-49c6-a146-b122e3595f63:2993:1862467659912832:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1776187971.501315:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a4c9a23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659913088:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1776187971.501375:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187971.501474:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fffd3274 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2995:1862467659913152:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1776187971.501504:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187971.501705:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913088 00000100:00100000:1.0:1776187971.501753:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1776187971.501758:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d71b17f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2994:x1862467659913088:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1776187971.504474:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913152 00000100:00100000:3.0:1776187971.504565:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1776187971.504582:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d23e956 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2995:x1862467659913152:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1776187971.504677:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d23e956 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2995:x1862467659913152:12345-0@lo:400:kworker/u8:0.0 Request processed in 95us (3174us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187971.504685:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1776187971.504747:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fffd3274 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2995:1862467659913152:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1776187971.505146:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d71b17f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:2994:x1862467659913088:12345-0@lo:400:kworker/u8:0.0 Request processed in 3385us (3771us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187971.505155:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1776187971.508757:0:2994:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968195 gen 2 00000004:00080000:0.0:1776187971.508767:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000012c0d89e, transno 4294968135 00000004:00080000:0.0:1776187971.508856:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000024f833d6, transno 4294968136 00000004:00080000:0.0:1776187971.513500:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000c01fecec, transno 4294968137 00000004:00080000:0.0:1776187971.513512:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000812af665, transno 4294968138 00000004:00080000:0.0:1776187971.513514:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000060f785d2, transno 4294968139 00000004:00080000:0.0:1776187971.513517:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000031f2b725, transno 4294968140 00000004:00080000:0.0:1776187971.513519:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000008b1fba72, transno 4294968141 00000004:00080000:0.0:1776187971.513521:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000000346ea37, transno 4294968142 00000004:00080000:0.0:1776187971.513524:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000f965700f, transno 4294968143 00000004:00080000:0.0:1776187971.513526:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000a1d41ccf, transno 4294968144 00000004:00080000:0.0:1776187971.513527:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000002d2d18b4, transno 4294968145 00000004:00080000:0.0:1776187971.513529:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000dc0b983c, transno 4294968146 00000004:00080000:0.0:1776187971.513531:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000d41c77b6, transno 4294968147 00000004:00080000:0.0:1776187971.513533:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000060a1c46b, transno 4294968148 00000004:00080000:0.0:1776187971.513536:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000e7b8745b, transno 4294968149 00000004:00080000:0.0:1776187971.513538:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000818d4c03, transno 4294968150 00000004:00080000:0.0:1776187971.513540:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000617a485f, transno 4294968151 00000004:00080000:0.0:1776187971.513542:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000003ca7af7c, transno 4294968152 00000004:00080000:0.0:1776187971.513544:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000016b67d7f, transno 4294968153 00000004:00080000:0.0:1776187971.513546:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000f2203b2c, transno 4294968154 00000004:00080000:0.0:1776187971.513548:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000b584ae0e, transno 4294968155 00000004:00080000:0.0:1776187971.513551:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000a13701d1, transno 4294968156 00000004:00080000:0.0:1776187971.513553:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000890d49e1, transno 4294968157 00000004:00080000:0.0:1776187971.513555:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000005c5ca962, transno 4294968158 00000004:00080000:0.0:1776187971.513557:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000bf261950, transno 4294968159 00000004:00080000:0.0:1776187971.513560:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000002b294ced, transno 4294968160 00000004:00080000:0.0:1776187971.513562:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000005fa6ca06, transno 4294968161 00000004:00080000:0.0:1776187971.513564:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000009a14ab09, transno 4294968162 00000004:00080000:0.0:1776187971.513565:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000009157d9b5, transno 4294968163 00000004:00080000:0.0:1776187971.513787:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000002cd66b6b, transno 4294968164 00000004:00080000:0.0:1776187971.513791:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000ddc6d453, transno 4294968165 00000004:00080000:0.0:1776187971.513793:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000006d1f0f2e, transno 4294968166 00000004:00080000:0.0:1776187971.513795:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000041a08231, transno 4294968167 00000004:00080000:0.0:1776187971.513797:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000002e053a51, transno 4294968168 00000004:00080000:0.0:1776187971.513799:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000001ee6948, transno 4294968169 00000004:00080000:0.0:1776187971.513800:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000f43bbdf3, transno 4294968170 00000004:00080000:0.0:1776187971.513802:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000827745c3, transno 4294968171 00000004:00080000:0.0:1776187971.513804:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000a10603c3, transno 4294968172 00000004:00080000:0.0:1776187971.513806:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000006afce0ba, transno 4294968173 00000004:00080000:0.0:1776187971.513808:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000d74ae161, transno 4294968174 00000004:00080000:0.0:1776187971.513811:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000001a4e5517, transno 4294968175 00000004:00080000:0.0:1776187971.513813:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000028e219af, transno 4294968176 00000004:00080000:0.0:1776187971.513815:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000089eb1245, transno 4294968177 00000004:00080000:0.0:1776187971.513817:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000046010e85, transno 4294968178 00000004:00080000:0.0:1776187971.513819:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000d58dfd0f, transno 4294968179 00000004:00080000:0.0:1776187971.513821:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000218fbb0b, transno 4294968180 00000004:00080000:0.0:1776187971.513823:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000005bb15d8e, transno 4294968181 00000004:00080000:0.0:1776187971.513825:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000dde06a41, transno 4294968182 00000004:00080000:0.0:1776187971.513827:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000862e5412, transno 4294968183 00000004:00080000:0.0:1776187971.513829:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000871c4100, transno 4294968184 00000004:00080000:0.0:1776187971.513831:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000f0a54e30, transno 4294968185 00000004:00080000:0.0:1776187971.513834:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000ead899a8, transno 4294968186 00000004:00080000:0.0:1776187971.513836:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000095d509fe, transno 4294968187 00000004:00080000:0.0:1776187971.513837:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000002b2a2aca, transno 4294968188 00000004:00080000:0.0:1776187971.513840:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000068f8989e, transno 4294968189 00000004:00080000:0.0:1776187971.513842:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000035f62d55, transno 4294968190 00000004:00080000:0.0:1776187971.513844:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000df83f436, transno 4294968191 00000004:00080000:0.0:1776187971.513846:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000007eb3c018, transno 4294968192 00000004:00080000:0.0:1776187971.513848:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000009ee57b4c, transno 4294968193 00000004:00080000:0.0:1776187971.513851:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000008729ebb9, transno 4294968194 00000004:00080000:0.0:1776187971.513853:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000138d96d2, transno 4294968195 00000100:00100000:0.0:1776187971.513866:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a4c9a23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659913088:0@lo:400:kworker/u8:0.0 00000004:00080000:2.0:1776187971.514314:0:6807:0:(osp_sync.c:1124:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 59 done 00000100:00100000:0.0:1776187972.206860:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187972.206955:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187972.206994:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187972.207183:0:5509:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453888 00000100:00100000:2.0:1776187972.207209:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653453952 00000100:00100000:2.0:1776187972.207262:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:1.0:1776187972.207263:0:5509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 300 00000100:00100000:1.0:1776187972.207275:0:5509:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000220ace41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2ae673b-89a8-4483-906b-6087e209f7f4+9:2224:x1862467653453888:12345-192.168.204.20@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1776187972.207276:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b2b6ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:2225:x1862467653453952:12345-192.168.204.20@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1776187972.207383:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454016 00000100:00100000:3.0:1776187972.207421:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:3.0:1776187972.207425:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004376936e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+7:2224:x1862467653454016:12345-192.168.204.20@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1776187972.210012:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b2b6ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+28:2225:x1862467653453952:12345-192.168.204.20@tcp:400:kworker/u8:2.0 Request processed in 2727us (3151us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187972.210034:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 210 00000100:00100000:1.0:1776187972.214193:0:5509:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000220ace41 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2ae673b-89a8-4483-906b-6087e209f7f4+9:2224:x1862467653453888:12345-192.168.204.20@tcp:400:kworker/u8:2.0 Request processed in 6900us (7216us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187972.214219:0:5509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 300 00000100:00100000:3.0:1776187972.214743:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004376936e pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+7:2224:x1862467653454016:12345-192.168.204.20@tcp:400:kworker/u8:2.0 Request processed in 7133us (7565us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187972.214758:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 123 00000100:00100000:2.0:1776187972.215041:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187972.217444:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454080 00000100:00100000:3.0:1776187972.217535:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 124 00000100:00100000:3.0:1776187972.217543:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ceb0237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+15:2225:x1862467653454080:12345-192.168.204.20@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1776187972.218052:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ceb0237 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+15:2225:x1862467653454080:12345-192.168.204.20@tcp:400:kworker/u8:2.0 Request processed in 507us (3011us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187972.218062:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 124 00010000:00010000:0.0:1776187972.456215:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1776187973.032410:0:6809:0:(osp_sync.c:1658:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 450016532588ns, next at 451016529902ns, rc = 0 00000100:00100000:3.0:1776187973.032540:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000330d0ea8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659913216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1776187973.032615:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187973.032912:0:6331:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913216 00000100:00100000:0.0:1776187973.032968:0:6331:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1776187973.032974:0:6331:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fffd3274 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2996:x1862467659913216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1776187973.033010:0:6331:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 18743296 granted 177143808 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1776187973.033063:0:6331:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fffd3274 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2996:x1862467659913216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187973.033072:0:6331:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1776187973.034636:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000330d0ea8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2996:1862467659913216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1776187973.482662:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1776187973.645258:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 103 committed 00000001:00080000:0.0:1776187973.645293:0:5537:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 4294975143 is committed 00000004:00080000:0.0:1776187973.645305:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 105 committed 00000004:00080000:0.0:1776187973.645315:0:5537:0:(osp_sync.c:1623:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 104 committed 00000001:00080000:0.0:1776187973.645328:0:5537:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 4294975147 is committed 00000100:00100000:0.0:1776187973.645532:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000330d0ea8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659913344:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187973.645598:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187973.645623:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000b916d83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659913600:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187973.645643:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187973.645663:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1776187973.645669:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007e04bcb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659913280:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187973.645687:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187973.645701:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000346ea37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659913536:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187973.645718:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187973.645740:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c01fecec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659913408:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187973.645760:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187973.645773:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000048ad97c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659913664:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187973.645790:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187973.645805:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1776187973.645810:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000060f785d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659913472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1776187973.645828:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187973.645855:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b4f1da6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659913728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187973.646050:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913344 00000100:00100000:3.0:1776187973.646107:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913600 00000100:00100000:3.0:1776187973.646126:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913280 00000100:00100000:3.0:1776187973.646142:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913536 00000100:00100000:3.0:1776187973.646157:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913408 00000100:00100000:3.0:1776187973.646171:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913664 00000100:00100000:3.0:1776187973.646185:0:6326:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913472 00000100:00100000:3.0:1776187973.646202:0:6326:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2908 00000100:00100000:3.0:1776187973.646208:0:6326:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d402306 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+71:2994:x1862467659913344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1776187973.646238:0:6326:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:240 count 1 00010000:00010000:3.0:1776187973.646268:0:6326:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 3/0,1 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646292:0:6326:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000adada2e5/0x92b1eb87ee41dd0a lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a2d expref: 14 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646301:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187973.646304:0:6326:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187973.646306:0:6326:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 4/0,1 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646331:0:6326:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000adada2e5/0x92b1eb87ee41dd0a lrc: 3/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a2d expref: 14 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646343:0:6326:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000adada2e5/0x92b1eb87ee41dd0a lrc: 4/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a2d expref: 14 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:3.0:1776187973.646353:0:6326:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000c480202 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6326:1862467659913792:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187973.646410:0:6326:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fb3a20f4 going to sleep for 43 seconds 00000100:00100000:3.0:1776187973.646429:0:11824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2909 00000100:00100000:3.0:1776187973.646434:0:11824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0b0b298 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+71:2994:x1862467659913600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1776187973.646446:0:11824:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:233 count 1 00010000:00010000:3.0:1776187973.646456:0:11824:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 3/0,1 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646466:0:11824:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000385c9cea/0x92b1eb87ee41d67a lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c178d expref: 14 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646473:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187973.646474:0:11824:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187973.646476:0:11824:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 4/0,1 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646492:0:11824:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000385c9cea/0x92b1eb87ee41d67a lrc: 3/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c178d expref: 14 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646500:0:11824:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000385c9cea/0x92b1eb87ee41d67a lrc: 4/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c178d expref: 14 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:3.0:1776187973.646508:0:11824:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036115f06 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:11824:1862467659913856:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187973.646531:0:11824:0:(client.c:2500:ptlrpc_set_wait()) set 0000000020bf3161 going to sleep for 43 seconds 00000100:00100000:3.0:1776187973.646546:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2910 00000100:00100000:3.0:1776187973.646550:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000671fe4d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+71:2994:x1862467659913280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1776187973.646560:0:11816:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:287 count 1 00010000:00010000:3.0:1776187973.646569:0:11816:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 3/0,1 mode: --/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646577:0:11816:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003aee7632/0x92b1eb87ee42093a lrc: 2/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2bf3 expref: 14 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646583:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187973.646584:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187973.646585:0:11816:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 4/0,1 mode: --/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646600:0:11816:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003aee7632/0x92b1eb87ee42093a lrc: 3/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2bf3 expref: 14 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646612:0:11816:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003aee7632/0x92b1eb87ee42093a lrc: 4/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2bf3 expref: 14 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:3.0:1776187973.646620:0:11816:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a4c9a23 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:11816:1862467659913920:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187973.646641:0:11816:0:(client.c:2500:ptlrpc_set_wait()) set 0000000096e84579 going to sleep for 43 seconds 00000100:00100000:3.0:1776187973.646656:0:9338:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2911 00000100:00100000:3.0:1776187973.646660:0:9338:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e45ad3e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+71:2994:x1862467659913536:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1776187973.646670:0:9338:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:234 count 1 00010000:00010000:3.0:1776187973.646681:0:9338:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 3/0,1 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646691:0:9338:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6aef2da/0x92b1eb87ee41d737 lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17da expref: 14 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646699:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187973.646701:0:9338:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187973.646702:0:9338:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 4/0,1 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646720:0:9338:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6aef2da/0x92b1eb87ee41d737 lrc: 3/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17da expref: 14 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646729:0:9338:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6aef2da/0x92b1eb87ee41d737 lrc: 4/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17da expref: 14 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:3.0:1776187973.646737:0:9338:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c2de1de4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9338:1862467659913984:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187973.646760:0:9338:0:(client.c:2500:ptlrpc_set_wait()) set 000000004bcc2b55 going to sleep for 43 seconds 00000100:00100000:3.0:1776187973.646777:0:11790:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2912 00000100:00100000:3.0:1776187973.646781:0:11790:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f36a4a62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+71:2995:x1862467659913408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1776187973.646794:0:11790:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:238 count 1 00010000:00010000:3.0:1776187973.646804:0:11790:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 3/0,1 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646813:0:11790:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e018b6d/0x92b1eb87ee41db4a lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1977 expref: 14 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646818:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187973.646819:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1776187973.646820:0:11790:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 4/0,1 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646837:0:11790:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e018b6d/0x92b1eb87ee41db4a lrc: 3/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1977 expref: 14 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.646845:0:11790:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e018b6d/0x92b1eb87ee41db4a lrc: 4/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1977 expref: 14 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:3.0:1776187973.646852:0:11790:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db4ef2c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659914048:192.168.204.20@tcp:104: 00000100:00100000:3.0:1776187973.646872:0:11790:0:(client.c:2500:ptlrpc_set_wait()) set 000000008ff58339 going to sleep for 43 seconds 00000100:00100000:0.0:1776187973.647247:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187973.647791:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fd316459 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659914112:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1776187973.648454:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187973.648486:0:2993:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1776187973.648495:0:2993:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ac78150 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659914176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1776187973.648528:0:2993:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187973.648570:0:11797:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659913728 00000100:00100000:2.0:1776187973.648609:0:11797:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659914112 00000100:00100000:2.0:1776187973.648628:0:11797:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659914176 00000100:00100000:2.0:1776187973.648639:0:11797:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2913 00000100:00100000:2.0:1776187973.648645:0:11797:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016e072e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+72:2995:x1862467659913664:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187973.648672:0:11797:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:427 count 1 00010000:00010000:2.0:1776187973.648701:0:11797:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 3/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.648717:0:11797:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085f55609/0x92b1eb87ee438999 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8b8 expref: 14 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.648724:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.648726:0:11797:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.648728:0:11797:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 4/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.648754:0:11797:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085f55609/0x92b1eb87ee438999 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8b8 expref: 14 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.648764:0:11797:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085f55609/0x92b1eb87ee438999 lrc: 4/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8b8 expref: 14 pid: 6326 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.648781:0:11797:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000058b38222 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:11797:1862467659914240:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187973.648834:0:11797:0:(client.c:2500:ptlrpc_set_wait()) set 00000000688042f6 going to sleep for 43 seconds 00000100:00100000:2.0:1776187973.648850:0:11796:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2914 00000100:00100000:2.0:1776187973.648854:0:11796:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045040602 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+72:2995:x1862467659913472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187973.648865:0:11796:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:288 count 1 00010000:00010000:2.0:1776187973.648892:0:11796:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 3/0,1 mode: --/PW res: [0x120:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.648902:0:11796:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001df6e424/0x92b1eb87ee4209f7 lrc: 2/0,0 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c40 expref: 14 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.648907:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.648909:0:11796:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.648910:0:11796:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 4/0,1 mode: --/PW res: [0x120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.648924:0:11796:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001df6e424/0x92b1eb87ee4209f7 lrc: 3/0,0 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c40 expref: 14 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.648932:0:11796:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001df6e424/0x92b1eb87ee4209f7 lrc: 4/0,0 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c40 expref: 14 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.648940:0:11796:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000630996cd pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:11796:1862467659914304:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187973.648958:0:11796:0:(client.c:2500:ptlrpc_set_wait()) set 00000000b2ce0e6a going to sleep for 43 seconds 00000100:00100000:2.0:1776187973.648973:0:6328:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2915 00000100:00100000:2.0:1776187973.648976:0:6328:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006072665c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:2995:x1862467659913728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187973.648987:0:6328:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:230 count 1 00010000:00010000:2.0:1776187973.648996:0:6328:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 3/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.649004:0:6328:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0a854e0/0x92b1eb87ee41cbe5 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c140d expref: 14 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.649010:0:6328:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.649011:0:6328:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.649012:0:6328:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 4/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.649026:0:6328:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0a854e0/0x92b1eb87ee41cbe5 lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c140d expref: 14 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.649033:0:6328:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0a854e0/0x92b1eb87ee41cbe5 lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c140d expref: 14 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.649041:0:6328:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e3e3c369 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6328:1862467659914368:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187973.649058:0:6328:0:(client.c:2500:ptlrpc_set_wait()) set 000000007c5e116f going to sleep for 43 seconds 00000100:00100000:2.0:1776187973.649086:0:11792:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2916 00000100:00100000:2.0:1776187973.649089:0:11792:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003469a13f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:2993:x1862467659914112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1776187973.649101:0:11792:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:230 count 1 00010000:00010000:2.0:1776187973.649114:0:11792:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 3/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.649124:0:11792:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c2c68ac/0x92b1eb87ee41cd20 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x40000000020000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c147d expref: 6 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.649134:0:11792:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.649135:0:11792:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.649136:0:11792:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 4/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.649155:0:11792:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c2c68ac/0x92b1eb87ee41cd20 lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x50000000030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c147d expref: 6 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.649163:0:11792:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c2c68ac/0x92b1eb87ee41cd20 lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x70000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c147d expref: 6 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.649172:0:11792:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f965700f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:11792:1862467659914432:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187973.649193:0:11792:0:(client.c:2500:ptlrpc_set_wait()) set 00000000fac0fcfa going to sleep for 43 seconds 00000100:00100000:0.0:1776187973.650197:0:10783:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2917 00000100:00100000:0.0:1776187973.650207:0:10783:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071bce4b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:2993:x1862467659914176:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1776187973.650232:0:10783:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x0:231 count 1 00010000:00010000:0.0:1776187973.650249:0:10783:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 3/0,1 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.650264:0:10783:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a6bdbc9/0x92b1eb87ee41cfe3 lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1564 expref: 6 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.650272:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187973.650274:0:10783:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1776187973.650275:0:10783:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 4/0,1 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.650299:0:10783:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a6bdbc9/0x92b1eb87ee41cfe3 lrc: 3/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1564 expref: 6 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.650309:0:10783:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a6bdbc9/0x92b1eb87ee41cfe3 lrc: 4/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x70000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1564 expref: 6 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1776187973.650320:0:10783:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009726b67 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10783:1862467659914496:192.168.204.20@tcp:104: 00000100:00100000:0.0:1776187973.650420:0:10783:0:(client.c:2500:ptlrpc_set_wait()) set 000000008546d52d going to sleep for 43 seconds 00000100:00100000:2.0:1776187973.654795:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187973.654823:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187973.654841:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187973.654859:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187973.654936:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187973.654968:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454272 00010000:00010000:2.0:1776187973.655009:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6aef2da/0x92b1eb87ee41d737 lrc: 5/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17da expref: 15 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.655044:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454208 00010000:00010000:2.0:1776187973.655053:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000385c9cea/0x92b1eb87ee41d67a lrc: 5/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c178d expref: 16 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.655078:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454144 00010000:00010000:2.0:1776187973.655088:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000adada2e5/0x92b1eb87ee41dd0a lrc: 5/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a2d expref: 17 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.655099:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454336 00010000:00010000:2.0:1776187973.655106:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003aee7632/0x92b1eb87ee42093a lrc: 5/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2bf3 expref: 18 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.655116:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454400 00010000:00010000:2.0:1776187973.655123:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e018b6d/0x92b1eb87ee41db4a lrc: 5/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1977 expref: 19 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.655136:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4438 00000100:00100000:2.0:1776187973.655143:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000455af04d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+19:2224:x1862467653454272:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187973.655160:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187973.655165:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6aef2da/0x92b1eb87ee41d737 lrc: 5/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17da expref: 19 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.655175:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6aef2da/0x92b1eb87ee41d737 lrc: 4/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17da expref: 19 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.655205:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.655207:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.655211:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655220:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 4/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655246:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187973.655299:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000455af04d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+19:2224:x1862467653454272:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 156us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187973.655308:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4438 00000100:00100000:2.0:1776187973.655365:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4439 00000100:00100000:2.0:1776187973.655370:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1d41ccf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:2223:x1862467653454208:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1776187973.655376:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187973.655381:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000385c9cea/0x92b1eb87ee41d67a lrc: 5/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c178d expref: 18 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.655389:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000385c9cea/0x92b1eb87ee41d67a lrc: 4/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c178d expref: 18 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.655400:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.655402:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.655403:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655410:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 4/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655421:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187973.655437:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1d41ccf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:2223:x1862467653454208:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 67us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187973.655444:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4439 00000100:00100000:2.0:1776187973.655456:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4440 00000100:00100000:2.0:1776187973.655460:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d2d18b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+17:2223:x1862467653454144:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1776187973.655466:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187973.655470:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000adada2e5/0x92b1eb87ee41dd0a lrc: 5/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a2d expref: 17 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.655479:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000adada2e5/0x92b1eb87ee41dd0a lrc: 4/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a2d expref: 17 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.655492:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.655493:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.655495:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655502:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 4/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655513:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187973.655528:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d2d18b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+17:2223:x1862467653454144:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 67us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187973.655534:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4440 00000100:00100000:2.0:1776187973.655545:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4441 00000100:00100000:2.0:1776187973.655549:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc0b983c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+16:2223:x1862467653454336:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1776187973.655556:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187973.655559:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003aee7632/0x92b1eb87ee42093a lrc: 5/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2bf3 expref: 16 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.655567:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003aee7632/0x92b1eb87ee42093a lrc: 4/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2bf3 expref: 16 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.655579:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.655581:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.655582:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 3/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655588:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 4/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655599:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187973.655613:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc0b983c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+16:2223:x1862467653454336:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 63us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187973.655619:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4441 00000100:00100000:2.0:1776187973.655628:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4442 00000100:00100000:2.0:1776187973.655631:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000818d4c03 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+15:2224:x1862467653454400:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187973.655637:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187973.655641:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e018b6d/0x92b1eb87ee41db4a lrc: 5/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1977 expref: 15 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.655650:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e018b6d/0x92b1eb87ee41db4a lrc: 4/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1977 expref: 15 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.655661:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.655662:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.655664:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655670:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 4/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655679:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187973.655694:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000818d4c03 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+15:2224:x1862467653454400:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 61us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187973.655700:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4442 00010000:00010000:2.0:1776187973.655931:0:11816:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aee7632/0x92b1eb87ee42093a lrc: 0/0,0 mode: --/PW res: [0x11f:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2bf3 expref: 14 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.655952:0:11816:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a4c9a23 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:11816:1862467659913920:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187973.655981:0:11816:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 3/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655991:0:11816:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 3/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.655997:0:11816:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 3/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.656006:0:11816:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 3/0,1 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.656012:0:11816:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 2/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.656035:0:11816:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187973.656463:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000671fe4d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+73:2994:x1862467659913280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9910us (10774us total) trans 4294968231 rc 0/0 00000100:00100000:2.0:1776187973.656475:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2910 00000004:00080000:2.0:1776187973.656523:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000007e04bcb1/2, rc 0, transno 935 00000100:00100000:2.0:1776187973.656534:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007e04bcb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659913280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187973.656618:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000617a485f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659914560:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187973.656665:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187973.656703:0:11816:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659914560 00000100:00100000:2.0:1776187973.656731:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2918 00000100:00100000:2.0:1776187973.656736:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c5ca962 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+73:2995:x1862467659914560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187973.656760:0:11816:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:231 count 1 00010000:00010000:2.0:1776187973.656784:0:11816:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 3/0,1 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.656799:0:11816:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b4e1c86/0x92b1eb87ee41cf88 lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1548 expref: 13 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.656806:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.656808:0:11816:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.656810:0:11816:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 4/0,1 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.656833:0:11816:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b4e1c86/0x92b1eb87ee41cf88 lrc: 3/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1548 expref: 13 pid: 11825 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.656843:0:11816:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b4e1c86/0x92b1eb87ee41cf88 lrc: 4/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x70000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1548 expref: 13 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.656854:0:11816:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf261950 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:11816:1862467659914624:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187973.656952:0:11816:0:(client.c:2500:ptlrpc_set_wait()) set 000000001b578632 going to sleep for 43 seconds 00010000:00010000:2.0:1776187973.657025:0:11790:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e018b6d/0x92b1eb87ee41db4a lrc: 0/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1977 expref: 13 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.657043:0:11790:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db4ef2c4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659914048:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187973.657061:0:11790:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657087:0:11790:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657093:0:11790:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657103:0:11790:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 3/0,1 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657110:0:11790:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657127:0:11790:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1776187973.657341:0:11790:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f36a4a62 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:2995:x1862467659913408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10559us (11580us total) trans 4294968232 rc 0/0 00000100:00100000:2.0:1776187973.657350:0:11790:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2912 00010000:00010000:2.0:1776187973.657372:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1776187973.657377:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 2/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657384:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000128add9d already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187973.657387:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 2/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657395:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 3/0,0 mode: PW/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657414:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 1/0,0 mode: --/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657419:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000128add9d/0x92b1eb87ee43a6cd lrc: 0/0,0 mode: --/PW res: [0x11f:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657436:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187973.657439:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657445:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000052d92773 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187973.657447:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 2/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657453:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 3/0,0 mode: PW/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657463:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 1/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657468:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052d92773/0x92b1eb87ee43a6db lrc: 0/0,0 mode: --/PW res: [0xee:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657479:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187973.657481:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187973.657482:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1776187973.657505:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000c01fecec/2, rc 0, transno 936 00000100:00100000:2.0:1776187973.657514:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c01fecec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659913408:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187973.657554:0:2995:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1776187973.657562:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a14ab09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659914688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187973.657591:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187973.657618:0:11790:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659914688 00000100:00100000:2.0:1776187973.657641:0:11790:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2919 00000100:00100000:2.0:1776187973.657645:0:11790:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad791b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:2995:x1862467659914688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1776187973.657659:0:11790:0:(ofd_dev.c:1822:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x0:232 count 1 00010000:00010000:2.0:1776187973.657672:0:11790:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 3/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657683:0:11790:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000defdec57/0x92b1eb87ee41d03e lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1580 expref: 12 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657689:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.657690:0:11790:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1776187973.657692:0:11790:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 4/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657710:0:11790:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000defdec57/0x92b1eb87ee41d03e lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000000010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1580 expref: 12 pid: 11794 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657718:0:11790:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000defdec57/0x92b1eb87ee41d03e lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x70000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1580 expref: 12 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.657728:0:11790:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000025c71879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659914752:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187973.657758:0:11790:0:(client.c:2500:ptlrpc_set_wait()) set 0000000096e84579 going to sleep for 6 seconds 00010000:00010000:2.0:1776187973.657803:0:11824:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000385c9cea/0x92b1eb87ee41d67a lrc: 0/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c178d expref: 12 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.657816:0:11824:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036115f06 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:11824:1862467659913856:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187973.657828:0:11824:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657834:0:11824:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657839:0:11824:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657846:0:11824:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 3/0,1 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657852:0:11824:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.657867:0:11824:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187973.658041:0:11824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0b0b298 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+75:2994:x1862467659913600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11606us (12397us total) trans 4294968233 rc 0/0 00000100:00100000:2.0:1776187973.658048:0:11824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2909 00010000:00010000:2.0:1776187973.658748:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187973.658755:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.658772:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000030c08888 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187973.658775:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 2/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.658782:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 3/0,0 mode: PW/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.658799:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 1/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.658805:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030c08888/0x92b1eb87ee43a6c6 lrc: 0/0,0 mode: --/PW res: [0xe9:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11824 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.658825:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187973.658826:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187973.660270:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187973.660302:0:9338:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6aef2da/0x92b1eb87ee41d737 lrc: 0/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c17da expref: 11 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1776187973.660341:0:9338:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c2de1de4 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9338:1862467659913984:192.168.204.20@tcp:104: 00010000:00010000:0.0:1776187973.660381:0:9338:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.660396:0:9338:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.660405:0:9338:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.660422:0:9338:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 3/0,1 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.660431:0:9338:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.660460:0:9338:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187973.660796:0:5504:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187973.660803:0:5504:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.660815:0:5504:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007a73b3e2 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187973.660818:0:5504:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 2/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.660826:0:5504:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 3/0,0 mode: PW/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.660854:0:5504:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 1/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.660861:0:5504:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a73b3e2/0x92b1eb87ee43a6d4 lrc: 0/0,0 mode: --/PW res: [0xea:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9338 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.660890:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187973.660892:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187973.660902:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1776187973.660952:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000000b916d83/2, rc 0, transno 937 00000100:00100000:2.0:1776187973.660960:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000b916d83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659913600:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1776187973.661157:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00010000:00010000:2.0:1776187973.661182:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1776187973.661206:0:11797:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000058b38222 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:11797:1862467659914240:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187973.661235:0:11797:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 3/0,1 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187973.661270:0:11796:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000630996cd pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:11796:1862467659914304:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187973.661295:0:11796:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 3/0,1 mode: --/PW res: [0x120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187973.661330:0:6328:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e3e3c369 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6328:1862467659914368:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187973.661342:0:6328:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 3/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187973.661371:0:11792:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f965700f pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:11792:1862467659914432:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187973.661384:0:11792:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 3/0,1 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1776187973.661411:0:10783:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009726b67 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10783:1862467659914496:192.168.204.20@tcp:104: 00010000:00010000:2.0:1776187973.661433:0:10783:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 3/0,1 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187973.661440:0:9338:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e45ad3e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:2994:x1862467659913536:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14772us (15714us total) trans 4294968234 rc 0/0 00000100:00100000:0.0:1776187973.661468:0:9338:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2911 00000100:00100000:2.0:1776187973.661483:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454720 00010000:00010000:2.0:1776187973.661521:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a6bdbc9/0x92b1eb87ee41cfe3 lrc: 4/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1564 expref: 7 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1776187973.661550:0:6326:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adada2e5/0x92b1eb87ee41dd0a lrc: 0/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1a2d expref: 10 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.661562:0:5501:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4443 00000100:00100000:0.0:1776187973.661569:0:6326:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000c480202 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6326:1862467659913792:192.168.204.20@tcp:104: 00000100:00100000:2.0:1776187973.661579:0:5501:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012fd664c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+7:2222:x1862467653454720:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1776187973.661598:0:5501:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187973.661603:0:6326:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.661609:0:5501:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a6bdbc9/0x92b1eb87ee41cfe3 lrc: 4/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1564 expref: 7 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1776187973.661631:0:6326:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.661638:0:5501:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a6bdbc9/0x92b1eb87ee41cfe3 lrc: 3/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1564 expref: 7 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1776187973.661662:0:6326:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.661675:0:6326:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 3/0,1 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.661688:0:6326:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.661713:0:6326:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187973.662035:0:5501:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a6bdbc9/0x92b1eb87ee41cfe3 lrc: 0/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1564 expref: 7 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.662055:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.662058:0:5501:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.662062:0:5501:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.662084:0:5501:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 4/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.662116:0:5501:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187973.662183:0:5501:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012fd664c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+6:2222:x1862467653454720:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 609us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187973.662192:0:5501:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4443 00000004:00080000:2.0:1776187973.662241:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000000346ea37/2, rc 0, transno 938 00000100:00100000:2.0:1776187973.662246:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000346ea37 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659913536:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1776187973.662270:0:10783:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.662280:0:10783:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.662291:0:10783:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.662299:0:10783:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1776187973.662307:0:6326:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d402306 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:2994:x1862467659913344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16094us (16705us total) trans 4294968235 rc 0/0 00000100:00100000:0.0:1776187973.662319:0:6326:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2908 00010000:00010000:2.0:1776187973.662326:0:10783:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1776187973.664466:0:10783:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071bce4b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:2993:x1862467659914176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14253us (15931us total) trans 4294968196 rc 0/0 00000100:00100000:2.0:1776187973.664483:0:10783:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2917 00010000:00010000:3.0:1776187973.665175:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1776187973.665183:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.665201:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000547596a2 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187973.665206:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 2/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.665215:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 3/0,0 mode: PW/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.665240:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 1/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.665251:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000547596a2/0x92b1eb87ee43a6bf lrc: 0/0,0 mode: --/PW res: [0xf0:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.665270:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187973.665272:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.665278:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f56a3831 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187973.665279:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.665284:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 3/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.665293:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 1/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.665302:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f56a3831/0x92b1eb87ee43a6fe lrc: 0/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10783 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.665312:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187973.665313:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187973.665315:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1776187973.665629:0:2994:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000330d0ea8/2, rc 0, transno 939 00000100:00100000:2.0:1776187973.665637:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000330d0ea8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659913344:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1776187973.665660:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1776187973.666077:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000005ac78150/2, rc 0, transno 900 00000100:00100000:2.0:1776187973.666083:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ac78150 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659914176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1776187973.666142:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187973.666253:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187973.666278:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187973.666303:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187973.666326:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454464 00000100:00100000:2.0:1776187973.666340:0:7121:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454592 00010000:00010000:0.0:1776187973.666392:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085f55609/0x92b1eb87ee438999 lrc: 4/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8b8 expref: 11 pid: 6326 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1776187973.666447:0:5501:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454528 00000100:00100000:3.0:1776187973.667456:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454656 00010000:00010000:2.0:1776187973.667807:0:7121:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0a854e0/0x92b1eb87ee41cbe5 lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c140d expref: 12 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:2.0:1776187973.668351:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4444 00000100:00100000:2.0:1776187973.668359:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5db700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+12:2224:x1862467653454464:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1776187973.668375:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187973.668381:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085f55609/0x92b1eb87ee438999 lrc: 4/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8b8 expref: 12 pid: 6326 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.668393:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085f55609/0x92b1eb87ee438999 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8b8 expref: 12 pid: 6326 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.668415:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085f55609/0x92b1eb87ee438999 lrc: 0/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24ca8b8 expref: 12 pid: 6326 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.668429:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.668430:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.668434:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.668442:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 4/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.668469:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187973.668528:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5db700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+11:2224:x1862467653454464:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 169us (2387us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187973.668536:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4444 00000100:00100000:2.0:1776187973.668556:0:7121:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4445 00000100:00100000:2.0:1776187973.668561:0:7121:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000064c752c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+10:2224:x1862467653454592:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:2.0:1776187973.668569:0:7121:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1776187973.668572:0:7121:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0a854e0/0x92b1eb87ee41cbe5 lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c140d expref: 10 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.668581:0:7121:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0a854e0/0x92b1eb87ee41cbe5 lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c140d expref: 10 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.668593:0:7121:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0a854e0/0x92b1eb87ee41cbe5 lrc: 0/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c140d expref: 10 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:2.0:1776187973.668603:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.668604:0:7121:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1776187973.668606:0:7121:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.668612:0:7121:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 4/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.668629:0:7121:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1776187973.668645:0:7121:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000064c752c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+9:2224:x1862467653454592:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 84us (2393us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187973.668652:0:7121:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4445 00010000:00010000:2.0:1776187973.670959:0:11797:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.670978:0:11797:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.670987:0:11797:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 3/0,1 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.670993:0:11797:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.671012:0:11797:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1776187973.671353:0:11797:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016e072e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+75:2995:x1862467659913664:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22704us (25558us total) trans 4294968236 rc 0/0 00000100:00100000:2.0:1776187973.671363:0:11797:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2913 00010000:00010000:2.0:1776187973.671516:0:6328:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.671523:0:6328:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.671537:0:6328:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.671542:0:6328:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.671560:0:6328:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1776187973.671852:0:6328:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006072665c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+75:2995:x1862467659913728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22873us (25977us total) trans 4294968237 rc 0/0 00000100:00100000:2.0:1776187973.671859:0:6328:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2915 00000004:00080000:2.0:1776187973.671967:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000005b4f1da6/2, rc 0, transno 941 00000100:00100000:2.0:1776187973.671975:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b4f1da6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659913728:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1776187973.671986:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000048ad97c4/2, rc 0, transno 940 00000100:00100000:2.0:1776187973.671989:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000048ad97c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659913664:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1776187973.672006:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1776187973.672010:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.672018:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8111509 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187973.672021:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 2/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.672028:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 3/0,0 mode: PW/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.672048:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 1/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.672054:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8111509/0x92b1eb87ee43a6e2 lrc: 0/0,0 mode: --/PW res: [0x1ab:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11797 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.672082:0:5503:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187973.672085:0:5503:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.672091:0:5503:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a27740b3 already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187973.672093:0:5503:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.672099:0:5503:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.672107:0:5503:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 1/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.672112:0:5503:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a27740b3/0x92b1eb87ee43a6f0 lrc: 0/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6328 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.672123:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187973.672125:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187973.672126:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1776187973.672862:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1776187973.674965:0:5501:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001df6e424/0x92b1eb87ee4209f7 lrc: 4/0,0 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c40 expref: 8 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1776187973.675122:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4446 00000100:00100000:0.0:1776187973.675136:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000249e47c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+8:2224:x1862467653454528:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1776187973.675163:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1776187973.675183:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001df6e424/0x92b1eb87ee4209f7 lrc: 4/0,0 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c40 expref: 8 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1776187973.675200:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001df6e424/0x92b1eb87ee4209f7 lrc: 3/0,0 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c40 expref: 8 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1776187973.675237:0:5500:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001df6e424/0x92b1eb87ee4209f7 lrc: 0/0,0 mode: --/PW res: [0x120:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c2c40 expref: 8 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1776187973.675262:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187973.675265:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1776187973.675270:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 3/0,1 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.675283:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 4/0,1 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.675326:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1776187973.675415:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000249e47c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+7:2224:x1862467653454528:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 282us (9136us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187973.675436:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4446 00010000:00010000:0.0:1776187973.675472:0:11796:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 3/0,1 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.675482:0:11796:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 3/0,1 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.675493:0:11796:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 3/0,1 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.675500:0:11796:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 2/0,0 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1776187973.675520:0:11796:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1776187973.676289:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c2c68ac/0x92b1eb87ee41cd20 lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c147d expref: 6 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:3.0:1776187973.676378:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4447 00000100:00100000:3.0:1776187973.676390:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1ff9cf0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+6:2224:x1862467653454656:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 00010000:00010000:3.0:1776187973.676406:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187973.676412:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c2c68ac/0x92b1eb87ee41cd20 lrc: 4/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x60000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c147d expref: 6 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:3.0:1776187973.676428:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c2c68ac/0x92b1eb87ee41cd20 lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x50000400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c147d expref: 6 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:3.0:1776187973.676457:0:5502:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c2c68ac/0x92b1eb87ee41cd20 lrc: 0/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->53247) gid 0 flags: 0x44801400030020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c147d expref: 6 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:3.0:1776187973.676485:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187973.676488:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187973.676493:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.676508:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 4/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.676565:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187973.676629:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1ff9cf0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+5:2224:x1862467653454656:12345-192.168.204.20@tcp:103:ldlm_bl_01.0 Request processed in 240us (10324us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187973.676638:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4447 00010000:00010000:3.0:1776187973.678217:0:11792:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.678235:0:11792:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.678247:0:11792:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 3/0,1 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.678254:0:11792:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.678282:0:11792:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1776187973.678669:0:11792:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003469a13f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:2993:x1862467659914112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 29575us (30214us total) trans 4294968197 rc 0/0 00000100:00100000:3.0:1776187973.678691:0:11792:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2916 00000004:00080000:3.0:1776187973.678770:0:2993:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000fd316459/2, rc 0, transno 901 00000100:00100000:3.0:1776187973.678781:0:2993:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fd316459 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2993:1862467659914112:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1776187973.679209:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187973.679339:0:5500:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454784 00010000:00010000:3.0:1776187973.679367:0:5500:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b4e1c86/0x92b1eb87ee41cf88 lrc: 5/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1548 expref: 7 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:3.0:1776187973.679394:0:5500:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4448 00000100:00100000:3.0:1776187973.679400:0:5500:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000714c2236 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+7:2225:x1862467653454784:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 00010000:00010000:3.0:1776187973.679413:0:5500:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187973.679416:0:5500:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b4e1c86/0x92b1eb87ee41cf88 lrc: 5/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1548 expref: 7 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:3.0:1776187973.679426:0:5500:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b4e1c86/0x92b1eb87ee41cf88 lrc: 4/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1548 expref: 7 pid: 11825 timeout: 550 lvb_type: 0 00010000:00010000:3.0:1776187973.679450:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187973.679452:0:5500:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187973.679456:0:5500:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.679463:0:5500:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 4/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.679483:0:5500:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187973.679623:0:5500:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000714c2236 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+7:2225:x1862467653454784:12345-192.168.204.20@tcp:103:ldlm_bl_02.0 Request processed in 116us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187973.679630:0:5500:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4448 00010000:00010000:3.0:1776187973.679764:0:11816:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b4e1c86/0x92b1eb87ee41cf88 lrc: 0/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1548 expref: 6 pid: 11825 timeout: 550 lvb_type: 0 00000100:00100000:3.0:1776187973.679781:0:11816:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf261950 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:11816:1862467659914624:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187973.679798:0:11816:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.679805:0:11816:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.679811:0:11816:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.679818:0:11816:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 3/0,1 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.679825:0:11816:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.679840:0:11816:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1776187973.680176:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c5ca962 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+75:2995:x1862467659914560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 23438us (23510us total) trans 4294968238 rc 0/0 00000100:00100000:3.0:1776187973.680183:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2918 00010000:00010000:3.0:1776187973.680206:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1776187973.680211:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 2/0,0 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680219:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000025e5acf1 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187973.680222:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 2/0,0 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680229:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 3/0,0 mode: PW/PW res: [0x120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680241:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 1/0,0 mode: --/PW res: [0x120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680247:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000025e5acf1/0x92b1eb87ee43a6e9 lrc: 0/0,0 mode: --/PW res: [0x120:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680262:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1776187973.680264:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680270:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000089fb6120 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187973.680272:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 2/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680277:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 3/0,0 mode: PW/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680286:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 1/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680292:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089fb6120/0x92b1eb87ee43a6f7 lrc: 0/0,0 mode: --/PW res: [0xe6:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11792 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680305:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1776187973.680308:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680313:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000006b72ffb6 already unused, calling callback (00000000924fc23c) 00010000:00010000:3.0:1776187973.680315:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 2/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680320:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 3/0,0 mode: PW/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680328:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 1/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680332:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b72ffb6/0x92b1eb87ee43a705 lrc: 0/0,0 mode: --/PW res: [0xe7:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11816 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680342:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187973.680343:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1776187973.680344:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1776187973.680367:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 00000000617a485f/2, rc 0, transno 942 00000100:00100000:3.0:1776187973.680372:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000617a485f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659914560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1776187973.680395:0:11790:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000025c71879 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:11790:1862467659914752:192.168.204.20@tcp:104: 00010000:00010000:3.0:1776187973.680408:0:11790:0:(ldlm_request.c:283:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 3/0,1 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.680421:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187973.681656:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187973.682174:0:5502:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454848 00010000:00010000:3.0:1776187973.682213:0:5502:0:(ldlm_lockd.c:2638:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000defdec57/0x92b1eb87ee41d03e lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1580 expref: 6 pid: 11794 timeout: 550 lvb_type: 0 00000100:00100000:3.0:1776187973.682262:0:5502:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4449 00000100:00100000:3.0:1776187973.682269:0:5502:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c480202 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+6:2225:x1862467653454848:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1776187973.682283:0:5502:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1776187973.682289:0:5502:0:(ldlm_lockd.c:1771:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000defdec57/0x92b1eb87ee41d03e lrc: 4/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x60000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1580 expref: 6 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:3.0:1776187973.682300:0:5502:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000defdec57/0x92b1eb87ee41d03e lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x50000400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1580 expref: 6 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:3.0:1776187973.682326:0:5502:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000defdec57/0x92b1eb87ee41d03e lrc: 0/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x44801400010020 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24c1580 expref: 6 pid: 11794 timeout: 550 lvb_type: 0 00010000:00010000:3.0:1776187973.682342:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187973.682345:0:5502:0:(ldlm_extent.c:318:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1776187973.682349:0:5502:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.682358:0:5502:0:(ldlm_resource.c:1650:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 4/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.682379:0:5502:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1776187973.682417:0:5502:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c480202 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+5:2225:x1862467653454848:12345-192.168.204.20@tcp:103:ldlm_bl_03.0 Request processed in 148us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187973.682424:0:5502:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4449 00010000:00010000:3.0:1776187973.682548:0:11790:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.682557:0:11790:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.682566:0:11790:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 3/0,1 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.682573:0:11790:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187973.682589:0:11790:0:(ldlm_lockd.c:2159:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1776187973.684057:0:7120:0:(ldlm_lockd.c:2789:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1776187973.684079:0:7120:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.684092:0:7120:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009369a8fa already unused, calling callback (00000000924fc23c) 00010000:00010000:2.0:1776187973.684097:0:7120:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 2/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.684106:0:7120:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 3/0,0 mode: PW/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.684134:0:7120:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 1/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.684140:0:7120:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009369a8fa/0x92b1eb87ee43a70c lrc: 0/0,0 mode: --/PW res: [0xe8:0x0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11790 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187973.684165:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187973.684166:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1776187973.684167:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187973.687666:0:11790:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad791b86 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+75:2995:x1862467659914688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30014us (30069us total) trans 4294968239 rc 0/0 00000100:00100000:3.0:1776187973.688647:0:11790:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2919 00000004:00080000:3.0:1776187973.689199:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 000000009a14ab09/2, rc 0, transno 943 00000100:00100000:3.0:1776187973.689509:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a14ab09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659914688:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1776187973.689960:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1776187973.692344:0:11796:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045040602 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+75:2995:x1862467659913472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 43476us (46502us total) trans 4294968240 rc 0/0 00000100:00100000:0.0:1776187973.692383:0:11796:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2914 00000004:00080000:3.0:1776187973.692810:0:2995:0:(osp_sync.c:562:osp_sync_interpret()) reply req 0000000060f785d2/2, rc 0, transno 944 00000100:00100000:3.0:1776187973.692823:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000060f785d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659913472:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1776187973.699320:0:7131:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968229 is committed 00000001:00080000:2.0:1776187973.699400:0:7131:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968230 is committed 00010000:00010000:3.0:1776187974.504348:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1776187974.639279:0:6351:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968196 is committed 00000001:00080000:2.0:1776187974.639310:0:6351:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0000: transno 4294968197 is committed 00010000:00010000:2.0:1776187975.529240:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187976.380531:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.381418:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653454976 00000100:00100000:2.0:1776187976.381514:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15819 00000100:00100000:2.0:1776187976.381525:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2de1de4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+13:11423:x1862467653454976:12345-192.168.204.20@tcp:101:diff.0 00010000:00010000:2.0:1776187976.381556:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187976.381586:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009369a8fa/0x92b1eb87ee43a713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac3f expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187976.381774:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1ea:0x0]: returning size 11776 00010000:00010000:2.0:1776187976.382047:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 000000009369a8fa/0x92b1eb87ee43a713 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac3f expref: 15 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187976.382058:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009369a8fa/0x92b1eb87ee43a713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac3f expref: 15 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187976.382080:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009369a8fa, rc 0) 00000100:00100000:2.0:1776187976.382167:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2de1de4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+14:11423:x1862467653454976:12345-192.168.204.20@tcp:101:diff.0 Request processed in 643us (1651us total) trans 4294975148 rc 301/301 00000100:00100000:2.0:1776187976.382183:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15819 00000100:00100000:1.0:1776187976.389329:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.389451:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455040 00000100:00100000:2.0:1776187976.389535:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4523 00000100:00100000:2.0:1776187976.389544:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9c2e81b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+14:11423:x1862467653455040:12345-192.168.204.20@tcp:37:diff.0 00000100:00100000:2.0:1776187976.395239:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9c2e81b pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+14:11423:x1862467653455040:12345-192.168.204.20@tcp:37:diff.0 Request processed in 4329us (4557us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.395267:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4523 00000100:00100000:0.0:1776187976.404618:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.404934:0:11766:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455168 00000100:00100000:2.0:1776187976.405007:0:11766:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4524 00000100:00100000:2.0:1776187976.405025:0:11766:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d28f60a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+14:11423:x1862467653455168:12345-192.168.204.20@tcp:35:diff.0 00000100:00100000:2.0:1776187976.405586:0:11766:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d28f60a pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+15:11423:x1862467653455168:12345-192.168.204.20@tcp:35:diff.0 Request processed in 560us (981us total) trans 4294975149 rc 0/0 00000100:00100000:2.0:1776187976.405596:0:11766:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4524 00000100:00100000:1.0:1776187976.408660:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.409446:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455232 00000100:00100000:2.0:1776187976.409532:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15820 00000100:00100000:2.0:1776187976.409541:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016d03f4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+15:11423:x1862467653455232:12345-192.168.204.20@tcp:101:diff.0 00010000:00010000:2.0:1776187976.409578:0:5516:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1776187976.409607:0:5516:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 000000009369a8fa/0x92b1eb87ee43a721 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac46 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187976.409694:0:5516:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a728 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1ed:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187976.409713:0:5516:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ed:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187976.409729:0:5516:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ed:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1776187976.409819:0:5516:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1ed:0x0]: returning size 11776 00000004:00200000:2.0:1776187976.409823:0:5516:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1776187976.409854:0:5516:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a728 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1ed:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187976.409936:0:5516:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 000000009369a8fa/0x92b1eb87ee43a721 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac46 expref: 17 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187976.409957:0:5516:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000a27740b3/0x92b1eb87ee43a728 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1ed:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac46 expref: 16 pid: 5516 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1776187976.409967:0:5516:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1ed:0x0].0x0 (00000000434f82b1) 00010000:00010000:2.0:1776187976.409970:0:5516:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1776187976.409975:0:5516:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000a27740b3, rc 0) 00000100:00100000:2.0:1776187976.410082:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016d03f4e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+16:11423:x1862467653455232:12345-192.168.204.20@tcp:101:diff.0 Request processed in 541us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.410091:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15820 00000100:00100000:0.0:1776187976.417343:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187976.417732:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455360 00000100:00100000:3.0:1776187976.417856:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15821 00000100:00100000:3.0:1776187976.417865:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059e06687 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+16:11423:x1862467653455360:12345-192.168.204.20@tcp:101:diff.0 00010000:00010000:3.0:1776187976.417920:0:6573:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1776187976.417951:0:6573:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a72f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70ee1d03a24cac4d expref: -99 pid: 6573 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1776187976.418141:0:6573:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x1ed:0x0]: returning size 11776 00010000:00010000:3.0:1776187976.418319:0:6573:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a72f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac4d expref: 18 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187976.418328:0:6573:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: 00000000547596a2/0x92b1eb87ee43a72f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1ea:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.20@tcp remote: 0x70ee1d03a24cac4d expref: 18 pid: 6573 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1776187976.418344:0:6573:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000547596a2, rc 0) 00000100:00100000:3.0:1776187976.418442:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059e06687 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+17:11423:x1862467653455360:12345-192.168.204.20@tcp:101:diff.0 Request processed in 577us (1112us total) trans 4294975150 rc 301/301 00000100:00100000:3.0:1776187976.418452:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15821 00000100:00100000:3.0:1776187976.424294:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.424462:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455424 00000100:00100000:2.0:1776187976.424555:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4525 00000100:00100000:2.0:1776187976.424563:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036115f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+17:11423:x1862467653455424:12345-192.168.204.20@tcp:37:diff.0 00000100:00100000:2.0:1776187976.437311:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036115f06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+17:11423:x1862467653455424:12345-192.168.204.20@tcp:37:diff.0 Request processed in 12733us (13017us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.437345:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4525 00000100:00100000:0.0:1776187976.444858:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.445038:0:5518:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455552 00000100:00100000:2.0:1776187976.445209:0:5518:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 4526 00000100:00100000:2.0:1776187976.445219:0:5518:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e9f160d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+17:11423:x1862467653455552:12345-192.168.204.20@tcp:35:diff.0 00000100:00100000:2.0:1776187976.447125:0:5518:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e9f160d pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11423:x1862467653455552:12345-192.168.204.20@tcp:35:diff.0 Request processed in 1897us (2270us total) trans 4294975151 rc 0/0 00000100:00100000:2.0:1776187976.447143:0:5518:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 4526 00000100:00100000:3.0:1776187976.470145:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.470454:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455616 00000100:00100000:0.0:1776187976.470733:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15822 00000100:00100000:0.0:1776187976.470742:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db4ef2c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455616:12345-192.168.204.20@tcp:501:chlg_load_threa.0 00000100:00100000:0.0:1776187976.471040:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db4ef2c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455616:12345-192.168.204.20@tcp:501:chlg_load_threa.0 Request processed in 298us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.471050:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15822 00000100:00100000:1.0:1776187976.476592:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187976.476734:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455680 00000100:00100000:3.0:1776187976.476866:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15823 00000100:00100000:3.0:1776187976.476893:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d211c1ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455680:12345-192.168.204.20@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1776187976.477282:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d211c1ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455680:12345-192.168.204.20@tcp:503:chlg_load_threa.0 Request processed in 402us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187976.477292:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15823 00000100:00100000:3.0:1776187976.480942:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.481567:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455744 00000100:00100000:0.0:1776187976.481658:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15824 00000100:00100000:0.0:1776187976.481667:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a4c9a23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455744:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.482258:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a4c9a23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455744:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 589us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.482269:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15824 00000100:00100000:0.0:1776187976.488074:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187976.488207:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455808 00000100:00100000:3.0:1776187976.488302:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15825 00000100:00100000:3.0:1776187976.488310:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e0f0926 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455808:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.489723:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e0f0926 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455808:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 1405us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.489742:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15825 00000100:00100000:1.0:1776187976.493610:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.494077:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455872 00000100:00100000:2.0:1776187976.494174:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15826 00000100:00100000:2.0:1776187976.494184:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005a2f2ffd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455872:12345-192.168.204.20@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1776187976.494357:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005a2f2ffd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455872:12345-192.168.204.20@tcp:501:chlg_load_threa.0 Request processed in 172us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.494368:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15826 00000100:00100000:2.0:1776187976.497700:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.497863:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653455936 00000100:00100000:1.0:1776187976.498035:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15827 00000100:00100000:1.0:1776187976.498043:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012fd664c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455936:12345-192.168.204.20@tcp:503:chlg_load_threa.0 00000100:00100000:1.0:1776187976.498319:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012fd664c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653455936:12345-192.168.204.20@tcp:503:chlg_load_threa.0 Request processed in 274us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.498329:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15827 00000100:00100000:0.0:1776187976.502866:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.503311:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456000 00000100:00100000:1.0:1776187976.503391:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15828 00000100:00100000:1.0:1776187976.503401:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e0ebc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456000:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187976.503724:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e0ebc48 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456000:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 323us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.503734:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15828 00000100:00100000:3.0:1776187976.508241:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.510672:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456064 00000100:00100000:2.0:1776187976.510929:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15829 00000100:00100000:2.0:1776187976.510940:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070dcc367 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456064:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.511307:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070dcc367 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456064:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 367us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.511317:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15829 00000100:00100000:0.0:1776187976.514273:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.515669:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456128 00000100:00100000:1.0:1776187976.515748:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15830 00000100:00100000:1.0:1776187976.515757:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009726b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456128:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187976.516061:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009726b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456128:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 304us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.516071:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15830 00000100:00100000:0.0:1776187976.520113:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.520280:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456192 00000100:00100000:2.0:1776187976.520363:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15831 00000100:00100000:2.0:1776187976.520373:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074844faf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456192:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.520682:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074844faf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456192:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 308us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.520693:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15831 00000100:00100000:1.0:1776187976.526974:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.527365:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456256 00000100:00100000:0.0:1776187976.527441:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15832 00000100:00100000:0.0:1776187976.527452:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f2203b2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456256:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.527749:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f2203b2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456256:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 298us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.527765:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15832 00000100:00100000:1.0:1776187976.531351:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.531506:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456320 00000100:00100000:2.0:1776187976.531592:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15833 00000100:00100000:2.0:1776187976.531599:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ead899a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456320:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.532048:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ead899a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456320:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 275us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.532059:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15833 00000100:00100000:3.0:1776187976.540826:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.541005:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456384 00000100:00100000:0.0:1776187976.541100:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15834 00000100:00100000:0.0:1776187976.541109:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5641d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456384:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.541428:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5641d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456384:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 318us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.541438:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15834 00000100:00100000:1.0:1776187976.549315:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.550120:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456448 00000100:00100000:2.0:1776187976.550206:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15835 00000100:00100000:2.0:1776187976.550217:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df83f436 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456448:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.551527:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df83f436 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456448:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 1151us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.551545:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15835 00010000:00010000:0.0:1776187976.552337:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1776187976.565695:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.566701:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456512 00000100:00100000:2.0:1776187976.566779:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15836 00000100:00100000:2.0:1776187976.566788:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007eb3c018 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456512:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.567165:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007eb3c018 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456512:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 376us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.567176:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15836 00000100:00100000:2.0:1776187976.572323:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.572478:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456576 00000100:00100000:0.0:1776187976.572564:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15837 00000100:00100000:0.0:1776187976.572574:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5db700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456576:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.572870:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5db700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456576:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 296us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.572966:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15837 00000100:00100000:1.0:1776187976.575749:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.575945:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456640 00000100:00100000:2.0:1776187976.576067:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15838 00000100:00100000:2.0:1776187976.576077:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008729ebb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456640:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.576428:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008729ebb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456640:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 343us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.576439:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15838 00000100:00100000:1.0:1776187976.580218:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.580548:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456704 00000100:00100000:2.0:1776187976.580639:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15839 00000100:00100000:2.0:1776187976.580650:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ca7af7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456704:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.581732:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ca7af7c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456704:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 1075us (1807us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.581751:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15839 00000100:00100000:3.0:1776187976.587745:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.587929:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456768 00000100:00100000:2.0:1776187976.588023:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15840 00000100:00100000:2.0:1776187976.588031:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007658a4ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456768:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.588319:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007658a4ef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456768:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 287us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.588626:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15840 00000100:00100000:0.0:1776187976.603563:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.604174:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456832 00000100:00100000:2.0:1776187976.604246:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15841 00000100:00100000:2.0:1776187976.604253:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049f832fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456832:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.604551:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049f832fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456832:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 297us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.604568:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15841 00000100:00100000:2.0:1776187976.616749:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1776187976.616783:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13701d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659914816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1776187976.616934:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1776187976.617124:0:7603:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659914816 00000100:00100000:1.0:1776187976.617209:0:7603:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1776187976.617216:0:7603:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e46ee9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:2994:x1862467659914816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1776187976.617271:0:7603:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 17039360 granted 272564224 pending 0 free 3824156672 avail 3822059520 00000100:00100000:1.0:1776187976.617327:0:7603:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e46ee9f pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+15:2994:x1862467659914816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.617335:0:7603:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1776187976.617386:0:2994:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294968230 gen 2 00000004:00080000:1.0:1776187976.617393:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000008dcb65fe, transno 4294968171 00000004:00080000:1.0:1776187976.617403:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000c493e10a, transno 4294968172 00000004:00080000:1.0:1776187976.617406:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000ed0ab337, transno 4294968173 00000004:00080000:1.0:1776187976.617408:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000053e106e4, transno 4294968174 00000004:00080000:1.0:1776187976.617411:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000b768e705, transno 4294968175 00000004:00080000:1.0:1776187976.617414:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000004f16eb28, transno 4294968176 00000004:00080000:1.0:1776187976.617416:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000f9699837, transno 4294968177 00000004:00080000:1.0:1776187976.617419:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000eb462d1a, transno 4294968178 00000004:00080000:1.0:1776187976.617423:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000025fccc35, transno 4294968179 00000004:00080000:1.0:1776187976.617426:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000e127d529, transno 4294968180 00000004:00080000:1.0:1776187976.617428:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000c7d6744b, transno 4294968181 00000004:00080000:1.0:1776187976.617431:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000402a2b37, transno 4294968182 00000004:00080000:1.0:1776187976.617433:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000a6d51526, transno 4294968183 00000004:00080000:1.0:1776187976.617436:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000280e0900, transno 4294968184 00000004:00080000:1.0:1776187976.617438:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000060cbfe30, transno 4294968185 00000004:00080000:1.0:1776187976.617440:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000000bf0cc0f, transno 4294968186 00000004:00080000:1.0:1776187976.617442:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000050e0db89, transno 4294968187 00000004:00080000:1.0:1776187976.617445:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000acae3e30, transno 4294968188 00000004:00080000:1.0:1776187976.617447:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000037e2dad, transno 4294968189 00000004:00080000:1.0:1776187976.617449:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000d0975cc8, transno 4294968190 00000004:00080000:1.0:1776187976.617452:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000036df82dd, transno 4294968191 00000004:00080000:1.0:1776187976.617454:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000c4ec120a, transno 4294968192 00000004:00080000:1.0:1776187976.617457:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000007929426f, transno 4294968193 00000004:00080000:1.0:1776187976.617460:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000001a1507ae, transno 4294968194 00000004:00080000:1.0:1776187976.617462:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000032853440, transno 4294968195 00000004:00080000:1.0:1776187976.617464:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000d31787e1, transno 4294968196 00000004:00080000:1.0:1776187976.617467:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000008739b0da, transno 4294968197 00000004:00080000:1.0:1776187976.617470:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000346b9b2f, transno 4294968198 00000004:00080000:1.0:1776187976.617473:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000004ae3186e, transno 4294968199 00000004:00080000:1.0:1776187976.617489:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000003e42c13a, transno 4294968200 00000004:00080000:1.0:1776187976.617492:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000dd1918da, transno 4294968201 00000004:00080000:1.0:1776187976.617494:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000d3eeab83, transno 4294968202 00000004:00080000:1.0:1776187976.617497:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000071fa85c3, transno 4294968203 00000004:00080000:1.0:1776187976.617500:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000050642aa4, transno 4294968204 00000004:00080000:1.0:1776187976.617502:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000009b2fcc41, transno 4294968205 00000004:00080000:1.0:1776187976.617504:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000030fe3c5, transno 4294968206 00000004:00080000:1.0:1776187976.617507:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000be51259f, transno 4294968207 00000004:00080000:1.0:1776187976.617509:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000093ea1a11, transno 4294968208 00000004:00080000:1.0:1776187976.617512:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000007dcbae96, transno 4294968209 00000004:00080000:1.0:1776187976.617514:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000000ee3389a, transno 4294968210 00000004:00080000:1.0:1776187976.617517:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000083801d1, transno 4294968211 00000004:00080000:1.0:1776187976.617519:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000294394ae, transno 4294968212 00000004:00080000:1.0:1776187976.617522:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000cd9a9483, transno 4294968213 00000004:00080000:1.0:1776187976.617524:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000001b161714, transno 4294968214 00000004:00080000:1.0:1776187976.617527:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000fb87fcf0, transno 4294968215 00000004:00080000:1.0:1776187976.617529:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000cfad8e60, transno 4294968216 00000004:00080000:1.0:1776187976.617531:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000db1b501c, transno 4294968217 00000004:00080000:1.0:1776187976.617534:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000030d971c0, transno 4294968218 00000004:00080000:1.0:1776187976.617536:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000618c42d3, transno 4294968219 00000004:00080000:1.0:1776187976.617539:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000a8535afd, transno 4294968220 00000004:00080000:1.0:1776187976.617541:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000f5b781a5, transno 4294968221 00000004:00080000:1.0:1776187976.617544:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000005b776bd0, transno 4294968222 00000004:00080000:1.0:1776187976.617547:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 0000000009fb7075, transno 4294968223 00000004:00080000:1.0:1776187976.617549:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000005a6d022f, transno 4294968224 00000004:00080000:1.0:1776187976.617551:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000cdf55e6c, transno 4294968225 00000004:00080000:1.0:1776187976.617554:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000005cd1bbde, transno 4294968226 00000004:00080000:1.0:1776187976.617556:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000fa12d7bd, transno 4294968227 00000004:00080000:1.0:1776187976.617559:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000001a3502aa, transno 4294968228 00000004:00080000:1.0:1776187976.617561:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000d65b5018, transno 4294968229 00000004:00080000:1.0:1776187976.617563:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000e88f43fc, transno 4294968230 00000100:00100000:1.0:1776187976.617569:0:2994:0:(client.c:2894:ptlrpc_free_committed()) @@@ stopping search req@000000007e04bcb1 x1862467659913280/t4294968231(4294968231) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1776187980 ref 1 fl Complete:RQU/4/0 rc 0/0 job:'osp-syn-1-0.0' 00000100:00100000:1.0:1776187976.617589:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13701d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659914816:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1776187976.618221:0:7288:0:(osp_sync.c:1124:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 10 in progress, 0 in flight, 60 done 00000100:00100000:2.0:1776187976.620034:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000346b9b2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2996:1862467659915008:0@lo:400:kworker/u8:5.0 00000100:00100000:2.0:1776187976.620144:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187976.620200:0:2996:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1776187976.620206:0:2996:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008739b0da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2996:1862467659914944:0@lo:400:kworker/u8:5.0 00000100:00100000:2.0:1776187976.620232:0:2996:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1776187976.620272:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659915008 00000100:00100000:2.0:1776187976.620325:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659914944 00000100:00100000:2.0:1776187976.620349:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1776187976.620355:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f0afe19 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2996:x1862467659915008:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:2.0:1776187976.620418:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f0afe19 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2996:x1862467659915008:12345-0@lo:400:kworker/u8:5.0 Request processed in 61us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.620426:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1776187976.620487:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000346b9b2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2996:1862467659915008:0@lo:400:kworker/u8:5.0 00000100:00100000:2.0:1776187976.620516:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1776187976.620520:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f6a1304 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2996:x1862467659914944:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:2.0:1776187976.620551:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f6a1304 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2996:x1862467659914944:12345-0@lo:400:kworker/u8:5.0 Request processed in 30us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.620558:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1776187976.620579:0:2996:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008739b0da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2996:1862467659914944:0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187976.621085:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d31787e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:124909f8-d332-49c6-a146-b122e3595f63:2994:1862467659914880:0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187976.621140:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187976.622225:0:2994:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1776187976.622422:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a13701d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2994:1862467659915136:0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187976.622494:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187976.622523:0:2994:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d65b5018 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659915072:0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187976.622553:0:2994:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1776187976.622594:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659915072 00000100:00100000:0.0:1776187976.622664:0:11796:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1776187976.622671:0:11796:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ee57b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2994:x1862467659915072:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187976.622744:0:11796:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ee57b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2994:x1862467659915072:12345-0@lo:400:kworker/u8:5.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.622751:0:11796:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1776187976.622795:0:2994:0:(client.c:2868:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968197 gen 2 00000004:00080000:0.0:1776187976.622802:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 000000005ac78150, transno 4294968196 00000100:00100000:3.0:1776187976.622811:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000004:00080000:0.0:1776187976.622815:0:2994:0:(osp_sync.c:508:osp_sync_request_commit_cb()) commit req 00000000fd316459, transno 4294968197 00000100:00100000:0.0:1776187976.622825:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d65b5018 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2994:1862467659915072:0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187976.622853:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659915136 00000100:00100000:0.0:1776187976.622872:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456896 00000100:00100000:3.0:1776187976.622919:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1776187976.622928:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008fab1ad5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1862467659915136:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187976.622930:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15842 00000100:00100000:0.0:1776187976.622939:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cd66b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456896:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187976.622983:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008fab1ad5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2994:x1862467659915136:12345-0@lo:400:kworker/u8:5.0 Request processed in 56us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187976.622990:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1776187976.623034:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a13701d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2994:1862467659915136:0@lo:400:kworker/u8:5.0 00000100:00100000:0.0:1776187976.623202:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cd66b6b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456896:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 264us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.623210:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15842 00000100:00100000:2.0:1776187976.623609:0:5509:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659914880 00000100:00100000:2.0:1776187976.625387:0:5509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1776187976.625398:0:5509:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e566b58e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124909f8-d332-49c6-a146-b122e3595f63+18:2994:x1862467659914880:12345-0@lo:400:kworker/u8:5.0 00000100:00100000:3.0:1776187976.625478:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.625506:0:5509:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e566b58e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124909f8-d332-49c6-a146-b122e3595f63+18:2994:x1862467659914880:12345-0@lo:400:kworker/u8:5.0 Request processed in 107us (4364us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.625516:0:5509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1776187976.625695:0:2994:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d31787e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:124909f8-d332-49c6-a146-b122e3595f63:2994:1862467659914880:0@lo:400:kworker/u8:5.0 00000100:00100000:1.0:1776187976.625734:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653456960 00000100:00100000:1.0:1776187976.625774:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15843 00000100:00100000:1.0:1776187976.625778:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e053a51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456960:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187976.625991:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e053a51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653456960:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 211us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.625999:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15843 00000100:00100000:3.0:1776187976.632093:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.633141:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457024 00000100:00100000:1.0:1776187976.633332:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15844 00000100:00100000:1.0:1776187976.633343:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001ee6948 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457024:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187976.635794:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001ee6948 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457024:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 2439us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.635816:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15844 00000100:00100000:3.0:1776187976.643223:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.643622:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457088 00000100:00100000:2.0:1776187976.643707:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15845 00000100:00100000:2.0:1776187976.643715:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f43bbdf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457088:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.644089:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f43bbdf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457088:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 374us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.644099:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15845 00000100:00100000:3.0:1776187976.651139:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.659685:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457152 00000100:00100000:1.0:1776187976.660067:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15846 00000100:00100000:1.0:1776187976.660078:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000827745c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457152:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187976.660389:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000827745c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457152:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 312us (9266us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.660409:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15846 00000100:00100000:3.0:1776187976.662632:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.664115:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457216 00000100:00100000:1.0:1776187976.664208:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15847 00000100:00100000:1.0:1776187976.664217:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035f62d55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457216:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187976.664563:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035f62d55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457216:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 345us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.664575:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15847 00000100:00100000:3.0:1776187976.671776:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.673307:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457280 00000100:00100000:2.0:1776187976.673404:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15848 00000100:00100000:2.0:1776187976.673412:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000071fa85c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457280:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.673702:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000071fa85c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457280:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 289us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.673712:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15848 00000100:00100000:3.0:1776187976.678922:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.679425:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457344 00000100:00100000:1.0:1776187976.679515:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15849 00000100:00100000:1.0:1776187976.679524:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b2fcc41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457344:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187976.679838:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b2fcc41 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457344:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 312us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.679848:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15849 00000100:00100000:3.0:1776187976.686752:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.686949:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457408 00000100:00100000:2.0:1776187976.687033:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15850 00000100:00100000:2.0:1776187976.687041:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be51259f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457408:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.687329:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be51259f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457408:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 287us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.687339:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15850 00000100:00100000:3.0:1776187976.692047:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.692112:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457472 00000100:00100000:0.0:1776187976.693105:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15851 00000100:00100000:0.0:1776187976.693117:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdf55e6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457472:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.693425:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdf55e6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457472:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 310us (1392us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.693435:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15851 00000100:00100000:3.0:1776187976.707345:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.707497:0:6573:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457536 00000100:00100000:0.0:1776187976.707574:0:6573:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15852 00000100:00100000:0.0:1776187976.707583:0:6573:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007258a0fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457536:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.708097:0:6573:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007258a0fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457536:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 513us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.708111:0:6573:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15852 00000100:00100000:3.0:1776187976.722172:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.723869:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457600 00000100:00100000:2.0:1776187976.724913:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15853 00000100:00100000:2.0:1776187976.724924:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba7165d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457600:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.725243:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba7165d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457600:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 318us (3084us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.725252:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15853 00000100:00100000:3.0:1776187976.728547:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.728683:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457664 00000100:00100000:1.0:1776187976.728755:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15854 00000100:00100000:1.0:1776187976.728763:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad6f5053 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457664:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187976.729070:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad6f5053 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457664:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 306us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.729081:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15854 00000100:00100000:3.0:1776187976.738432:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.738630:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457728 00000100:00100000:2.0:1776187976.738838:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15855 00000100:00100000:2.0:1776187976.738847:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9b6fe4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457728:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.739176:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9b6fe4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457728:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 326us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.739185:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15855 00000100:00100000:1.0:1776187976.746013:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187976.746411:0:5517:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457792 00000100:00100000:3.0:1776187976.746551:0:5517:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15856 00000100:00100000:3.0:1776187976.746560:0:5517:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d31787e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457792:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187976.747100:0:5517:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d31787e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457792:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 539us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187976.747110:0:5517:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15856 00000100:00100000:0.0:1776187976.750175:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.750843:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457856 00000100:00100000:1.0:1776187976.750967:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15857 00000100:00100000:1.0:1776187976.750975:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5b781a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457856:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187976.751289:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5b781a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457856:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 313us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.751300:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15857 00000100:00100000:0.0:1776187976.754992:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.755274:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457920 00000100:00100000:2.0:1776187976.755359:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15858 00000100:00100000:2.0:1776187976.755368:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009fb7075 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457920:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.755663:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009fb7075 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457920:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 294us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.755675:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15858 00000100:00100000:3.0:1776187976.760044:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.763674:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653457984 00000100:00100000:2.0:1776187976.763766:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15859 00000100:00100000:2.0:1776187976.763774:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000624fec33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457984:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.764127:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000624fec33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653457984:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 353us (4098us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.764137:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15859 00000100:00100000:0.0:1776187976.774213:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.774715:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458048 00000100:00100000:2.0:1776187976.774913:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15860 00000100:00100000:2.0:1776187976.774925:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fa12d7bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458048:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.775196:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fa12d7bd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458048:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 273us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.775207:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15860 00000100:00100000:0.0:1776187976.777776:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.781761:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458112 00000100:00100000:2.0:1776187976.781927:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15861 00000100:00100000:2.0:1776187976.781934:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000812af665 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458112:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.782253:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000812af665 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458112:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 317us (4488us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.782263:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15861 00000100:00100000:3.0:1776187976.790447:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.790573:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458176 00000100:00100000:2.0:1776187976.790662:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15862 00000100:00100000:2.0:1776187976.790669:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000837167e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458176:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.791643:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000837167e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458176:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 968us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.791658:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15862 00000100:00100000:1.0:1776187976.793699:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.793820:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458240 00000100:00100000:0.0:1776187976.793912:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15863 00000100:00100000:0.0:1776187976.793920:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b294ced pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458240:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.794237:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b294ced pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458240:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 316us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.794247:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15863 00000100:00100000:3.0:1776187976.796728:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187976.796871:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458304 00000100:00100000:1.0:1776187976.796996:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15864 00000100:00100000:1.0:1776187976.797018:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007912692b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458304:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1776187976.797570:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007912692b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458304:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 562us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187976.797583:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15864 00000100:00100000:3.0:1776187976.805604:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187976.807387:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458368 00000100:00100000:2.0:1776187976.808386:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15865 00000100:00100000:2.0:1776187976.808397:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b7505a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458368:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1776187976.808731:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b7505a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458368:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 335us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187976.808741:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15865 00000100:00100000:3.0:1776187976.817325:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.817641:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458432 00000100:00100000:0.0:1776187976.817709:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15866 00000100:00100000:0.0:1776187976.817719:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ebc8bb61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458432:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.818213:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ebc8bb61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458432:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 493us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.818225:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15866 00000100:00100000:3.0:1776187976.820283:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.821021:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458496 00000100:00100000:0.0:1776187976.821115:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15867 00000100:00100000:0.0:1776187976.821123:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5876235 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458496:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.822061:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5876235 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458496:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 933us (1785us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.822076:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15867 00000100:00100000:2.0:1776187976.826065:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.826160:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458560 00000100:00100000:0.0:1776187976.826227:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15868 00000100:00100000:0.0:1776187976.826235:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b117547 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458560:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.827340:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b117547 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458560:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 1099us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.827360:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15868 00000100:00100000:2.0:1776187976.831256:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.831740:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458624 00000100:00100000:0.0:1776187976.831865:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15869 00000100:00100000:0.0:1776187976.831912:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007b68c7c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458624:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.832261:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007b68c7c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458624:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 386us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.832271:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15869 00000100:00100000:1.0:1776187976.836716:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:0.0:1776187976.836857:0:12471:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458688 00000100:00100000:0.0:1776187976.836941:0:12471:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15870 00000100:00100000:0.0:1776187976.836949:0:12471:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095d509fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458688:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1776187976.837250:0:12471:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095d509fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458688:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 300us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1776187976.837261:0:12471:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15870 00000100:00100000:2.0:1776187976.841062:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187976.841234:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458752 00000100:00100000:3.0:1776187976.841370:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15871 00000100:00100000:3.0:1776187976.841379:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a1507ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458752:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187976.841682:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a1507ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458752:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 302us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187976.841691:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15871 00000100:00100000:2.0:1776187976.846318:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187976.846631:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458816 00000100:00100000:3.0:1776187976.846746:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15872 00000100:00100000:3.0:1776187976.846754:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032853440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458816:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187976.847079:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032853440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458816:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 324us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187976.847091:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15872 00000100:00100000:2.0:1776187976.850559:0:2987:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187976.850684:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458880 00000100:00100000:3.0:1776187976.850800:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15873 00000100:00100000:3.0:1776187976.850810:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000083801d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458880:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187976.851135:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000083801d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458880:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 326us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187976.851154:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15873 00000100:00100000:2.0:1776187976.854848:0:2988:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:3.0:1776187976.855287:0:5516:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653458944 00000100:00100000:3.0:1776187976.855489:0:5516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 15874 00000100:00100000:3.0:1776187976.855498:0:5516:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000294394ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458944:12345-192.168.204.20@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1776187976.855803:0:5516:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000294394ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fec2a005-a0e4-4122-9d32-29d5f089fd24+18:11425:x1862467653458944:12345-192.168.204.20@tcp:502:chlg_load_threa.0 Request processed in 305us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187976.855814:0:5516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 15874 00000100:00100000:2.0:1776187977.321123:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187977.321186:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:2.0:1776187977.321224:0:2986:0:(events.c:361:request_in_callback()) peer: 12345-192.168.204.20@tcp (source: 12345-192.168.204.20@tcp) 00000100:00100000:1.0:1776187977.321686:0:5509:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653459008 00000100:00100000:1.0:1776187977.322843:0:5509:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 302 00000100:00100000:1.0:1776187977.322855:0:5509:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000323a292d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2ae673b-89a8-4483-906b-6087e209f7f4+9:2222:x1862467653459008:12345-192.168.204.20@tcp:400:kworker/u8:3.0 00000100:00100000:1.0:1776187977.322976:0:5509:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000323a292d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2ae673b-89a8-4483-906b-6087e209f7f4+9:2222:x1862467653459008:12345-192.168.204.20@tcp:400:kworker/u8:3.0 Request processed in 121us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1776187977.322985:0:5509:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 302 00000100:00100000:0.0:1776187977.326629:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653459136 00000100:00100000:0.0:1776187977.327018:0:11796:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467653459072 00000100:00100000:2.0:1776187977.327563:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:2.0:1776187977.327575:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd9a9483 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fec2a005-a0e4-4122-9d32-29d5f089fd24+5:2222:x1862467653459136:12345-192.168.204.20@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1776187977.327752:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd9a9483 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fec2a005-a0e4-4122-9d32-29d5f089fd24+5:2222:x1862467653459136:12345-192.168.204.20@tcp:400:kworker/u8:3.0 Request processed in 176us (6563us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187977.327762:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 126 00000100:00100000:2.0:1776187977.327787:0:11816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.20@tcp, seq: 127 00000100:00100000:2.0:1776187977.327792:0:11816:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb87fcf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fec2a005-a0e4-4122-9d32-29d5f089fd24+5:2222:x1862467653459072:12345-192.168.204.20@tcp:400:kworker/u8:3.0 00000100:00100000:2.0:1776187977.327820:0:11816:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb87fcf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:fec2a005-a0e4-4122-9d32-29d5f089fd24+5:2222:x1862467653459072:12345-192.168.204.20@tcp:400:kworker/u8:3.0 Request processed in 28us (6597us total) trans 0 rc 0/0 00000100:00100000:2.0:1776187977.327827:0:11816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.20@tcp, seq: 127 00010000:00010000:3.0:1776187977.576985:0:5503:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1776187978.152354:0:2995:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000082be95a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659915200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1776187978.152437:0:2995:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1776187978.155075:0:6331:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1862467659915200 00000100:00100000:3.0:1776187978.155137:0:6331:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1776187978.155144:0:6331:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb5b5d8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2995:x1862467659915200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1776187978.155188:0:6331:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 18743296 granted 177143808 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1776187978.155273:0:6331:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb5b5d8b pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2995:x1862467659915200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2836us total) trans 0 rc 0/0 00000100:00100000:3.0:1776187978.155281:0:6331:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1776187978.160384:0:2995:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000082be95a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2995:1862467659915200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1776187978.603054:0:7120:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1776187978.728867:0:5537:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-MDT0000: transno 4294975151 is committed 00000001:00080000:2.0:1776187978.747288:0:7131:0:(tgt_lastrcvd.c:913:tgt_cb_last_committed()) lustre-OST0001: transno 4294968240 is committed 00000400:00000080:1.0:1776187978.921685:0:12559:0:(module.c:221:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1776187978.921692:0:12559:0:(debug.c:702:libcfs_debug_mark_buffer()) DEBUG MARKER: lustre-rsync-test test_2c: @@@@@@ FAIL: Failure in replication; differences found. 00010000:00010000:0.0:1776187979.625577:0:5504:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 24370 lines, 24370 kept, 0 dropped, 0 bad.